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ABSTRACT 



This report recommends items from international comparative 
education studies that are related to inservice professional development 
(IPD) for possible inclusion in the Schools and Staffing Survey of 1999-2000. 
To justify these recommendations, the value of international comparisons and 
of state and nation comparisons generally is discussed, along with a more 
specific discussion of their value with respect to IPD. This discussion is 
followed by sections on three relatively recent international comparative 
studies sponsored by the International Association for the Evaluation of 
Educational Achievement that have collected data on IPD and such related 
topics as school organization and environment: (1) the Reading Literacy 

Study; (2) the Computers in Education Study; and (3) the Third International 
Mathematics and Science Study (TIMSS) . Each of these sections describes the 
study, discusses the IPD- related items, and a few items that are not 
IPD-related but that are still recommended for the SASS. These sections also 
describe potential analyses using the recommended items and discuss items 
that are in both the international study and past versions of the SASS that 
could be used in a report on states and nations. A summary follows the 
sections on the three studies. It discusses benefits and disadvantages of 
using items from each survey in general terms, including depth of questions 
related to IPD, timeliness of data, and the number of participating 
countries. It also sets priorities on these items and provides a rationale 
for the priorities. A final section describes several of the rich sources of 
context data that have become available during the past 2 years. Five 
appendixes describe countries participating in the studies and provide 
descriptions of the three studies and components of the TIMSS. (Contains 9 
tables and 12 references.) (Author/SLD) 
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D»JTERNATIONAL COMPARISONS OF 
INSERVICE PROFESSIONAL DEVELOPMENT 



INTRODUCTION 

international°comparSive^SS^\^^ items from 

inservice professional development'' 

in SASS 1999-2000. To iustifv possible inclusion 

Of international oompfrisSi ’=>'® 

generally are discusied, followed La morS"'* nation comparisons 
of their value with respec? trupof. spedfio discussion 

recenriL^^Sj sLlSL^L”? three relatively 

Education study (Lm?EdL an?^ThlrdLi?^®' ' 1 ?°“*’“^®'^® 

Science Study (TIMSS) All thres» Mathematics and 

research projects coord S collaborative 

departments of education in mnn. .k ® .£ research centers and 
these three sec?ioS dSscJibeS =?“tries. Each of 

related items and a fL itiSS that ^^^cusses the IPD- 

recommended for SASS. They also describe\JSntia?^®^ 
using the recommended itemi and diSISss items 
the international study and oast 2 ^ 

used in a report on stLes and Nations. 

discuLS^hf bfnef??! and 3?2dvantage?of''!;s?na^i^ 

?srnniL"i?%Lna?*s;s 

also sets prioritiis on thfl^eSf anf LL?LsL°?S?La? ' e“ 
the priorities. ^ wviaes a rationale for 

d_. ®®cause of the importance of providing conteift -Por- 
describSs'‘sevS?al^of^the ?ich^^ countries, a final section 
become available during 
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PART I 



VALUE OP INTERNATIONAL COMPARISONS* 

policy relevance of SASS data could be enhanced by 

other nations. A nvunber^of 
discussed the value of international comparative 
education inf oraation. The most important use is considered to 
fBradbu^n^J^r^?? understanding of our own education system 

J is 1 In the absence of 

absolute standards for educational systems, comparative 

setting realistic standards and to 
the success of educational systems. Bradburn and 
Gilford recognize that comparisons with other states or the 

advantage of comparing systems that are broadly 
liar. International comparisons, however, expand the ranae of 

helpful not only for descriptive purposes, but also for 
monitoring Plomp (1992) stresses that international comparisons 
the policy makers and educators with information about 

the range of educational quality among various national systems 

international iilSraallon 

provides the opportunity to resolve the failings of our system in 
^ American way. They urge concentrating on the LasonJ 
behind countries decisions concerning teacher training policies. 
Understanding their motives and expectations will help us decide* 

Similarities in Cross-National issues 

countries are facing similar education policy 
issues. Several countries are involved in reform efforts and ^ 
many are faced with the issue of how to provide high quality^ 

® “^i^i’cultural student body. These common ^ 
oncerns enhance the likelihood that we can learn from the 
actions taken by other countries. Some of the issues relate 
specifically to IPD. Most countries that are members of the 
Organisation for Economic Co-operation and Development (OECD) are 
deepening inservice teaching opportunities, as are several Asian 
countries (Darling-Hammond, 1996). Many of them LvS recognizS 
the significant role of continuous professional development L an 
important part of professionalism (EURYDICE, 1995 ; Darlina- 
Hamond & Cobb, 1995) . Several countries are concerned about the 
limited opportunities for advancement and promotion in teachina 
and are taking action to create a career pith tha? woSld ^Sa^^ 



‘ This section summarizes the discussion of the value of 
international comparisons in an earlier paper (Gilford, 1996) that 
proposed adding items from the lEA CompEd study to SASS. ^ 
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toward highly accomplished practice over rho « 

career. In Spain and Portuaal incor-Tr-s^ the course of a teaching 

career advancement (EURYDICE, 1995 ) . ^ training is linked to 

imporXnce^of^giving\eacheri^SrSate^^^®^f^^ recognized the 

professional L?SnomranrSea?er vLc^t"^ teachers greater 
preparation, licensure, and p?acticef creating standards for 

Value of state and Nation Comparisons 

restruSu^ina*'S^''i?r®''\P®f^°‘? extensive reform and 

makers to ha?e inS?mJtion^Jbout^th^“^°^^^"^ policy 

involvement in effort Int teaching staff 

taking to upgrade their exneri-ieo actions teachers are 

to meet the demands of reform MthoSah^?hf^c!Sc i” 

include IPD data. SASS certaini^v^h^ Preparation, it does not 
state data on IPD. if the recomme!JdJ<-^*'^ potential to provide 
measures of IPD (Gilford 1996) to add^??^ earlier paper on 

provided to teachers, support fo?'l?o*'®Ld^?5^*' opportunities 
school environment that is supportive ' of ?pd!^ existence of a 

enhance! ^ further 

states to compare some ch“ac?erlKl!! S P°®®ibls for 

development activities with those in 

like that used in the NCES nublif'a'*--! countries in a format 

Kstions (O.s. Dipartaenf^/MiJIl^r^lflrflloM" 

the central role that teacharc; niat, ?' “ 1996). Because of 

states that have demonstrated iSteLit in''eduL??*'^®T®'"®i?^' 
in other countries (freouentlv fn-r ^‘^^cational achievement 

uses for such inflriatlOT? ^ economic reasons) would find 



REFERENCES: Part I 

Value of International Comparisons 

Government Accounting Office. * shington, D.C, 



i 



Education. ^ ngton D.C. . U.S. Department of 



In 



U.S. Department of 

°“^^??o?e™!S^and ?eMh;r^^aS°*’^ Teaching 

Darling-Ha™Sndrr^dT°L?^?Sb“ - 

EURYDICE^ The Information Network in v* 

EFTA/EEA Countries. (1995) ^ the 

°^“°DevelopSint“®ligge2Sd“t2inl^S®?r^°® Professional 
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PART II 

lEA READING LITERACY STUDY 

iiuLib'* aSie°5L:;:t. 

!?' study includes a number of guest ions 

schoo?"l"viro™S^raSS HD? 

English/JngSage’’L?l/«ading Itlthlll II 9S ^|||| lllXlll 

L~ 

recommended are ones that are associated with hi ah ^ ® 

indicators of desirable characteristics of IPD. Since ?he 

administered reading assessments 
“®®®^^®^^®ading proficiency to nationally 
representative samples of students in the 32 particioatina 

S S si;?; possible to compare thl Si i?tii??ies in 

fl I; with those of the countries whose students perfllmid 
n the reading assessments* (Appendix A lists the 27 

thrstit;^d;?a'';ith''ih^*^ Another approach would be to compare 
tne State data with the mean for the OECD countries that ^ 

RLS, as was done by Binkley and Williams for 
OECD means (or percentages) for the IPD-related variables would 

hees«l^?lele°“l?D 



Explanatory Variables in the RLS 

addition to the assessment of students' readina i i^-oT-a^u 
the RLS included four sets of guestionnlilS-etSIIII 
principal, and national — that were designed to collect data ahon-i- 
variables that were known to influence ?eadiig 

hat might vary across nations. An implicit model of readina 
achievement underlies these sets of questions A a^ie?;?^ 

SS^tiM map for the study (U.S. Departmint of 

it^S^h? ;hi ^ provides a cross classification of the data 
Items by the person or organizational unit to which they refer 
(students, their families, their teachers, and their schools ) and 
What information they provide. Four information categ^ri^J ir? 



used: attributes, the kinds of environments provided the foT-me: 

hSe*^ it is .complete framework is not reproduced 

Jk available as is a discussion of the analyses done to 
relate these factors to reading achievement (op. cit ) The n*»vi- 

section Identifies the IPD-related explanato^ va?iabl4s SSt 
appropriate for SASS 1999-2000. nacory variaeies that are 



Selection of Items for SASS 
Prom the U.S. Version of the RL8 Questionnaire 

RLS United States as part of the 

RliS contain four types of items: ^ 

international items— items that all countries must include, 

items — items proposed by the 

international organization but not required (generallv data 
for such items would be available for only p^flf the 
countries participating in the reading literacy Itudy^ 

special national option items — items that several countries 
agreed to include in their questionnaires , or 

U.S. items--items that were included only in the U S 
questionnaire, which would mean that no comparable* 
international data would be available. 



Only items of the first three types will be recommended for SASS 

available for U.S. items Note 

7® ^*^® optional international items and even more ^ 

limited for the special national options. 

IPD— Related Items Reconunexided for SASS 

M d-- IPD-related items that remain after deleting the U s 

1 identified as problem items during 

data analysis are recommended for inclusion in SASS 1999-2oSo 
Table I displays these items organized by relevant categorie^ 

framework. Appendix B contains a copy If the 
Items. They are also discussed in a later section on PoteSial 

toe Items, elong with f indingrebout 

the Items and illustrations of analyses using the items. 

General Reading Interests was also somewhat 
problematic. In an analysis of the international data on 

general reading interests, Lundberg and Linnakyla 
5°^?^ no clear relationships between teacher readership 
achievement. As a possible explanation of this 
result they suggest the possibility of a strong compliance effect 



TABLE I 



mSERVICE PR OFESSIOKAt. DEVELOPMENT 

FEA^OTO^^TEGOMES QDEST10NNAlRE*AND'iTms' 



ATTRIBUTES 



Teacher 



Further Education in Reading 


4T=9T^: 


11 


Inservice Reading Education 


4T=9T: 


12 


General Reading Interests 


4T=9T: 


17 


environment 






School 






School Resources 


4P=9P: 




Community Resources 


4P: 

9P: 


8 

8 


Parent Cooperation 


4P=9P: 


7 


Principal's Activities 


4P=9P: 


26 


School Organization 

Principal Discusses with 
Teacher 


4T: 

9T: 


64 

41 



tSr?"Jhe socSrdes??ab?n^ff:°tor^^^^^ -te 

cm, a 

countries, they JouAd tL? ?ea^if^i ^ advanced West EuropeaA 

countries (Finland, France, and SwedS) had 
level of readership than tAachers in higher average 

comparisons of characteristics of Since 

with those Of teacherrii Wes? **® S<^®Ces 

item has been retai?SI. *>® interest, this 



4T and 9T denote Teacher Questionnaire ■fnr* A'f-vi ^ j 
grade respectively. Analogously 4P a,Jd /p 1 ^ ^ 

Questionnaire for 4th grade and 'sth grade. Principal /School 

^ Some countries may not have used -i-hie: 
an international option. ^ guestion since it was 



IPD-Related Items that 



ere Not Recommended for 8ASS 



TABLE II 

ITEMS REIATED jo inservice PROFESSIONAL DEVELOPMENT 
EOT RECOMMENDED FOR 8ASS 

__E^^0^^CATEG0RIES QUESTIONNAIRE*^D*IT^r 

ATTRIBUTES ' 



School 

Principal's Education in 
Teaching Reading 

Principal's Inservice Readino 
Education ^ 



Teacher 

Inservice Reading Education 

ENVIRONMENT 

School 

Teacher's Wr> y]c Evaluated by 
— Principal : Frequency 

Teacher 's Work Fvaluat^rt Ky 
— ? Procedures 

School Organization 

Teacher 's Work Evaluat^rt Ky 
Principal 



4P=9P<: 38 

4P=9P: 39 

4T=9T: 13, 14 

_4P=9P; yi 
4P=9P; 



4T; 63 

STi 40 f=4T:fi^) 



9t St aff Meetings; 



School Program fo r Imnrr>viT.g 
Reading Instruction 



4.T; 67a. b. c. & ^ 

9T; 44 (=4T;67^ 

4P=9P; 24. 



for inclusion in SASS 
Principal 's Education 



V four items in the table— 

in Teaching Reading and Principal's 



* 4P and 9P denote School Ouestionnair-o j , 

grade respectively. AnalogoSsir and Jr ^ 

Questionnaire for 4th grade and 9th grade. ^ ^ denote Teacher 



Inservice Reading Education and the two items on Teacher's 
Inservice Reading Education— are U.S. national items, 
nternational data are not available for these four items. The 

underlined, were identified as 
problem items by Marilyn R. Binkley, U.S. National Research 
Coordinator for the study. The question on Items at Staff 

a structural problem. It involved interaction with 
the preceding item, which asked whether the school has staff 

clear responses for many of the 
^ble cells. The three questions related to Principal's ^ 
Evaluation of Teacher's Work were also problematic in cross- 
national analyses because some countries confused evaluation with 

question on School Program for Improving Reading 
Instructi^on was ambiguous because different countries have ^ 

concepts of what constitutes a ••program," which raises 
questions about the comparability of the country data. These 
rive questions are not recommended for SASS. 

Recommended Items that are Not IPO-Related 

displays two RLS items that are not IPD-related, 
Books in Library and Total Instructional Time, that are 
recommended for inclusion in SASS. They are recommended because 
they have been shown to be correlated with reading achievement 
IPD interest in a profile of indicators related to 



TABLE III 

RECOMMENDED ITEMS THAT ARE NOT IPD-RELATED 

FRAMEWORK CATEGORIES QUESTIONNAIRE AND ITEMS 

ENVIRONMENT 



School 

Books in Library 

School Organization 

Total Instructional Time 



4P=9P: 



4P=9P: 14 



The number of school library books per student* is an 
indicator that is highly correlated with reading achievement in 
the United States (U.S. Department of Education, 1994 p 418 - 
419) The correlation remains even after controlling " 
statistically for regional differences, parental support, and 
class size. Elley (1992, pp. 66-67) also notes that a clear link 



* This ratio can be computed for states and U.S. schools 
because the SASS school questionnaire contains a question on the 
number of students in the school. 






libraries was 

reiai-i™K^ surveys of individual countries Thi^ 

hlghlJ"corre?Stel‘*„?S‘'?2iH-°’=*^ instructional time is also 
report (U.S. Depar?meSt“fM^!catior“ 9 Sr or%? 5 ^rtf > ® 

academic achievement The promoting 

Offering 31 or mo?rAours 4 schools 

means for the expositorv significantly higher class 

those offertng ^“fSoSrS of ?S?r,'Jrt '=*=’= than 

means for schlols proviSino fl S? moS! k”’ ?”‘*® ®' <=*'« 

week instruction were sionif iranri»^°K* J'°“r’s of instruction per 
or fewer hours per week %or all those offering 25 

narrative, expofitoryfind Soci^lertf = 

Potential Analyses Using the Recommended Items 

evidence of the^importance^of ^the^rec'^°^°^H ’a provide 

to illustrate the varietv o-f recommended items and second, 

analyzing the data. Several interna^i”^^^°*^^a^^^^ used in 

reports have been published usino national 

Literacy Study. These ?enor?I ?2 ? a® Reading 

for countries or for groups of schoo^c^^^^K indicators 

sdjSStS'?Sr°Lmf eSii?onmSnt*'“ “i«'“'=“^“t''a^ievement 

options in an item or for » i S”®"*' *a=tor analysis for 

items; and use ormSLnSvJl 

collect data on reading aSlevSSrt’ toe^aafwftf® ‘’?®f 
Of Educational Progress provides state datf^L^^^ Assessment 

®"0 «>®- a?el?^;S\o link the 

natio;Si%j;°^^“ “tlisSuSe^leSctirinurt^^^ “"■* 

and findings from these oublicationc <->,11. ^^^^®^f®tive analyses 

toe eight IPD-relatefftflS aS ®®=*' 

for inclusion in SASS ^PoTnnr•oVl^v^ 9 ©neral items recommended 

and analyses i“to“rre^ortf S“2Jrfon^r® V. 

and nations comparison of ipd in readlngf)^ author of a states 

10 




18 



i 



International Studies 



analyses or cross national 

The first of these fEllev^ iqq 9 ^ reading literacy data. 

i?" IS- ^ 

iS"ioSldS?2 T"r'= 

country with what would be predicted on tile f ^ t^ie 

also presents comparisons of 
variables and litLacy 

2nd°tMchin“m2thodI*’and deteSn2^whilh°iSi?t”°*'“^®*'^°® ' 

-«"i«L”?vn^d"nss 

:s£a£~;™^^ 

characteristics of teachs»r-<i an^ find a number of 

associated „tS sLc2sS?uriSsteS"?„"^S??^“ 5*'"‘ 
noted above, they concluded thS fr^S the d«f S^^ilahyr^'.K® 
lEA study they could not identify instruct?onJi ^ i 

^ ^?-acy 

^ose^Sl ^h^selS^eflepItSr 

gtLa%?^tTSaJ?--| lhe-2M?et- M 



National Reports 



IO.S pu2!hhel “Sn?i^'rI*oSS 
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of the country with respect to reading achievement and the 
context of literacy instruction (classes, teachers, and school 
management) , and discuss the policy implications of the data for 
the education system. These reports include interesting 
interpretations of the reasons for their countries' rank in the 
international studies. Country reports that were easily 
accessible include those for Germany (Lehmann et al., 1995), Hong 
Kong (Johnson and Cheung Yatrshing, 1995), Ireland (Martin and 
Morgan, 1994) and the United States (U.S. Department of 
Education, 1994). For purposes of comparative analysis of U.S. 
states with nations it would be important to obtain the country 
reports from Canada and New Zealand, the other two English- 
speaking countries that participated in the study. 



Analyses Using IPO-Related Items Recommended for 8A8S 

Further Education in Reading This teacher attribute asks how 
many courses the teacher has completed related to the teaching of 
reading since initial teacher certification: none, one, two, 
three, or four or more. 

Martin and Morgan (1994 p. 51-53) compare this 
^^®^®cteristic of Irish teachers with those of other countries. 
They compute the mean number of hours that teachers report having 
spent on the study of reading since initial training and note 
that Irish teachers report very low levels — only four countries 
report lower levels. 

Inservice Reading Education This teacher attribute asks how many 
times the teacher has been to inservice teacher training courses 
ih reading in the last three years ; none, once, twice, three 
times, or four or more times. 

Martin and Morgan (1994, p. 52-57) convert the responses to 
this question to a scale of 1 to 5 and compute the mean for each 
country. Among the 27 countries that participated in the Grade 4 
tests, Irish teachers show the lowest frequency of attendance at 
inservice courses related to reading over the preceding three 
years. They note that this is not a criticism of teachers but 
the absence of a systematic approach to inservice. They note 
also a dearth of professional publications that are specifically 
aimed at practicing teachers. The policy relevance of this 
finding is evident. Similar analysis is carried out for 
Population B (14-year olds) teachers. This section also includes 
a discussion of the importance of professional development 
indicators, noting that a number of domains of teacher reading 
were found to be related to specific instructional practices. 

General Reading Interests This question asks how frequently 
(never or almost never, about once a year, about once a term, 
about once a month, about once a week or more) the teacher reads 



9 ' 



each of the following: articles on teaching, articles on 

reading, books on history or politics, books on the arts books 

cSifdJen?"' play?\ook^for " 

~a\ discussed earlier, Lundberg and Linnakyla (1993, pp. 35 - 

between teacher readership and 

student achievement across all RLS countries. On the other hand 

advanced ^ ten eSonoSlL^ly ' 

advanced countries, they found that teachers in the highest- 

eving countries had the highest average level of readershin 

in many Of the countries, teachers' own riading? inclSdinnoi 

S?t^ education but also literature^SaraSIoS^ated 

With higher reader scores for 9-year olds. 

Lundberg and Linnakyla (p. 89) also considered the number of 
countries where teaching factors discriminated significantly 
between effective and less effective classes and found that 
teacher readership did so in 17 countries. The largest number 

thei?''?epo?t.^°'' teaching factors considered in 

ont 'TJ'® ^'ftional report for Germany (Lehmann et al., 1995 p 
82) tabulates the percentages of East German and West German^* 

various types of subject matter at least once a 

are^hiohf^^J^^ children's books, the percentages 

are higher for West German 3rd year teachers than for East German 
teachers. For all types of reading material the perLnllgeT^i 
teachers are higher than those for 3 rd year teachers 
and the percentages for East German teachers are hiaher than 
those of west German teachers for books on hiSory « pomJcs 

tea^ifr^ Similar comparisins fol 

teachers in regions of the United States would be of interest. 

The national report for Ireland (Martin & Morgan 1994 ^ 
converts the frequency of reading responses into TlcSie of 1 to 

types of reading materials and computes the 
mean value for each type. They tabulate these mean values for 

three types of reading material: f^equLcy of 

reading articles on reading, frequency of reading articles on 

sca?ei"iA a?? Professional reading (the su^ of the reading 

scales in all nine areas specified in the item, which gives a 

scale from 9 to 45) . They note that only in East and wist Ge?manv 
do teachers read articles on teaching less frequently than iSh 
teachers and discuss the reasons for this finding. ^ Irish 

4th-grade school questionnaire asks whether 
the school has certain resources and activities: school librarv 

reading room for students, student/ school newspaper or magazine 
and a teacher (professional) library. The 9th grade scholl 
questionnaire adds four more activities: drama club, debating 
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club, literature club, and writing club. 

schooJs ?Sat ‘hat 

newspaper, or school students, a school 

that dS. johnso“and 2hSna ?at!shi™ than those 

«aS« each 

student achlevesen?^i^°real?ng 

?hr“al!abn??r?not“e;dSrava?l"Sf h° i"<^i-te 

town or city — less than 2 Hoht-c ^^^Isble in neighboring 

available lLany!-wi?Sin time--,^ 

time) of the following rLoSrcS^ Lbf i travel 

schijre''Al^h°er‘?“'??o°!; 

to 

^nia=S^e-orSSe°^2 wS„-%^-nng 



1994 report (U.S. Department of Education 

p. 320 ) the responses were reoreseni-f»H ac- ^ 4. 

«s“%^n ohf d\'^" °t 

rSsSu^ces^JiSeS ^ iTISL^f 

principles or goals (compared with other «3f'hr»r»ie 4-u 

knows) : nuch below average, beloS a^raoS aver.™® P“"=iPal 
average, much above average! average, average, above 






The United States report (pp. 417-418) finds a relationship 
parental support for the school and the mean level of ^ 
reading comprehension for fourth grade classes in the school. 

other attributes of communities, schools, 
principals, classes, and students that might confound this 

is^hiah"^?h^' holds. Where parental support for schools 

^ ^®,^®ading comprehension of fourth grade students is 
enhanced, and conversely, below average parental support is 

studoi?^®*^ below average reading comprehension^of the 

speculate that the reason this effect 
seems to be confined to fourth grade classrooms is that 

schools are more closely identified with their 
immediate community than are larger high schools that serve 
several conununities . 

Postlethwaite and Ross (1992, p. 34) found that degree of 
parent cooperation had the top rank internationally of their 56 

power in discriminating between more effective and 
less effective schools. This indicator ranked among the five 
most powerful in Belgium (French), Germany (West), Ireece, SSw 

UnitS*^States^^°^^' Spain, Sweden, Switzerland, and the 

Progr^ for Improving Reading Instruction This question asks the 
principal whether the scho«pl has a program for th^ imp?SveSnt o? 
jieadinq instruction (teaching and learning of reading) . if the 

it requests a description. This indicator 

power to discriminate between 
S ^®®® effective schools (Postlethwaite & Ross, 

p. 32) . It ranked among the five most powerful indicators in 
Spain and Switzerland. j-i-ators in 

Principal's Activities This question asked the principal to rank 

the following activities in order of importance in his/her work 
as a school principal: j-o/hbit worx 

Peprssenting the school at official meetinqs 
Evaluation of staff 

Contacts with local community (e.g., parents, community 
organizations, local industry) 

Discussing educational objectives with the teaching staff 
Administrative tasks concerning the functioning of the 
school (e.g., regulations, disciplinary duties, school 
budget, timetable) 

Using records of students' progress 

Taking care of issues of student welfare and guidance 
Activities aimed at the professional development of teachers 

Two of the activities, "discussing educational objectives with 
the teaching staff" and "activities aimed at the professional 
evelopment of teachers" are relevant to a supportive environment 
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Internationally, indicators for these items rank 47th 

their power to discriminate between 
1992 effective schools (Postlethwaite & Ross, 

case, the indicator is among the too 
respectiiSly?^^ °"® country—Norway and East Germany ^ 

noQA States report (U.S. Department of Education 

PP; 388-390) investigates a classroom-level model of the 
attributes for grades 4 and 9. The report 
a significant effect in the fourth grade model— principals 

readina^^ihi^^ promote staff development have higher levels of 
reading achievement in their schools. 

repoiTt for Ireland found that two of the activities were 

"Discusfion ®°^®,^®P°T^ant by principals than the others: 

educational objectives with staff" and 

tabulatS^fho^'^® tasks" (Martin & Morgan, 1994, p. 59-60). They 
tabulate the mean rankings of the importance of these two ^ 

oriicinaTS ^ activity (evaluation of teachers) by 

^ for each country for the elementary population. The 

froS ^^®“ objectives with staff" range 

S?nci;Lf°^ Iceland. The ranking for Irish 

p incipals, 2.3, IS similar to that of most other countries. 

Principal Discusses with Teacher This question asks the teacher 
to indicate whether the school principal (or deputy principal) 
engages in any of the following actions: principal) 

discuss explicit achievement standards for the subject 
that you teach? 

^^refding?^^^^^^°" results for progress of your students in 

make suggestions about the choice of instructional methods 
in reading? 

encourage contacts among teachers? 

initiatBaactivities directed at the professional development 

make suggestions about the content that must be covered 
in reading? 

Postlethwaite & Ross (1992, p. 45) develop a composite indicator 
principal engagement" from the options in this item. This 

ranks 45th internationally and only in Denmark is it 
°2J °£.^^® top five indicators in discriminating between more 
effective and less effective schools. 

•^nfi °®P®^tment of Education, 1994, pp. 

308-309) describes a factor analysis using data obtained f?om 
teachers' responses to a list of items describing 
principal/ teacher interactions. They identified two factors 
of which IS "staff development". This factor is based on two 



one 



l^“lopS2„^^Sf“«che2"''ani®"^ professional 

The authors found that the relationshin among teachers.” 

emphasis on staff deveinr,™««^^ between principal's 

negligible? wh?S sSens 

analyses osing Reeoniaenaed items that are Hot Related to ipd 

how many books^wlth'dIfferent*".i"fi?*i asked "Approximately 
contain? As menllgnf f !a???^r? 

association between larae c=n>ir»Ai (1992, pp. 66-67) found an 

scores in re^lnr libraries and mean achievement 

achievement scorl'for ni^th a® ‘*f®;®bic graph of reading 
size Fo!- w grade students by school librarv 

of school library^fSr each^country^ ^He°th^ quartiles by size 
scores for schools in each ouartn® computes the overall 

aggregated across all countries ^Thf country and the mean 

showing the mean overall The graph contains lines 

increase in average score with increases *in i*sk ^ regular 
for the highest quartile for the hiah rnr !! size (except 

difference between wealthier anH « countries) and a marked 

the GDI. wealthier and poorer countries as defined by 

mo??^«Stlv; ■ SSd°lL“e«^ti?f Lr 

between the mo?e effecti?^anS ?ISre?lecUvrslSoo?s^'"“'"""“" 
Linnakyla (1993 do 20 I 21 r aiSS'dc : ^undberg and 

is 

States, which makes fuller use of the ® 

distribution of total hours of iLtruction^athe^ tha^^?- -d-- 
comparisons to the mean instructional time. uniting 



A Possible Analysis Using the Recommended Items 

also be interesting to explore whether the 

inclui?n^°"^ explanatory variables recommended for 

the same relationships to reading 
EdIJiS??o®"D states in the 1992 National Assessment of 

foSn^beJufen^^r® (Mullis et al, 1993) as the relationships 
found between ttese variables and reading achievement in the 

the"l?i®^ participating in ^S. Both studies assess students in 

and the U^S reading used in the lEA's RLS 

would bt benefits fros such analyses 



Data Items in Both SASS and the Reading Literacy study 

to both^SAsI^aHS^pJc^"^?^^^®*^^ ® number of items common 

to both SASS and RLS. Some of them are associated with readina 

achievement, others can be used as classificatiorvSiablSS ^ 

They are mentioned here since they would require no additional 

^^®^ ^®®*^ ® states and nations 

report. These items include three teacher attributes* teacher 

’=«=*'ing experience, and teacSer eluiation? 

mnhei surveys include school enrollment, 

number of students per grade per gender, school control 

(p blic/private) , urbanicity, and percent of students absent 
There is one class attribute common to both surveys: c^alSsize. 

attribSLr»nd^°?®5^^^.^®^If®®" ®®®^ ^^® teacher 

anrna«lnar«po?ts"Sn“he'SL?“ international 

Teacher Gender 

Postlethwaite and Ross (1992, p. 34-35) reported that in 
many counteies nearly lOO percent of the reading teachSs w^?e 
female. Where this not the case, the more effective schools 
always had a higher proportion of female reading teachers than 
toe less effective schools. The indicator -peJLnt l^ale 
teachers" ranked number 10 of the 56 indicators investigated in 
power to detect difference between more effective schools and 
less effective schools internationally. ®'=^^''® schools and 

United States, no significant association was found 
between teacher gender and achievement, although children in 
classes with female teachers in grade 4 had higher mean scopes. 



as did students in classes with male teachers in grade 9 fU.S. 
Department of Education, 1994, pp. 287-288). It was noted, 
however, in connection with a model of the effects of five 
teacher attributes on average reading achievement (pp. 393-394), 
® fairly relaxed stance with regard to statistical 
significance was used, teacher gender could be considered as an 
influence on classroom achievement in reading comprehension in 
elementary schools. 

Teaching Experience 

- . T Both SASS and RLS have questions on the number of years of 
full-time teaching and the number of years of part-time teaching 
in an elementary or secondary school. ^ 



Elley (1992, p. _42) found that the variable years of teacher 
experience was associated with mean achievement score in reading. 
Countries in which mean achievement scores were in the top ten 
averaged 13.8 years of teacher experience, whereas the countries 
which were in the bottom ten averaged only 12.6 years. (The 
difference in years of teacher experience between the two groups 
of countries, however, was only 0.68 standard deviations.) A 
similar association between years of teacher education and 
student achievement remained after allowance was made for 
economic development. 



Lundberg & Linnakyla (p. 89-90) found that teacher experience 
discriminated significantly between effective and less effective 
classes in li countries. In the United States, however, the 
statistical correlation between years of teacher experience and 
student achievement in reading was low (U.S. Department of 
Education, 1994, pp. 289-299). 

Teacher Education 



Lundberg and Linnakyla (1993, p. 27) note that the number of 
years teachers have spent acquiring their education varies 
considerably across countries. Because of the varying patterns 
and the varying interpretations of the concept of teacher 
education they found it difficult to compare the length of 
education across countries. They conclude (p. 50) that «... the 
v^^istion between countries, in terms of how many years of 
®5^®rience the average teacher has, does not seem to be related 
to variation in national achievement level.” There is a positive 
association, however, within many countries. 



In the United States, however, the statistical correlation 
between years of teacher education and student achievement was 
low (U.S. Department of Education, 1994, pp. 288-290). In the 
model of the effects of teacher attributes on average reading 
achievement levels mentioned above, the author, Trevor Williams 
notes (p. 393) that if one takes a fairly relaxed stance with 



education could^be°considered°as°®' Perhaps teacher 
achievement. ^ influence on classroom 



toe RLS iteL recoBunMlIS to? InSliei®”- analyses using 

items common to SASS and nil to “SS combined with toe 

recommendations would S?o^4 slss «>e 

wide variety of analysSi M?nv^f ?? Potential tor a 

relevant to policv issn*»4 t£ analyses would be 

current reform movement in ^dJJ^atton?*’®’' *“''® *’®®" 



Reading Literacy study 

^Study^if^jlllaikg Liteiicy^^ ^he^H read? iea 

Association for the Evaluation of IS^iattoSS^toW^Lent . 

Lundberg, i. and ?• Linnakvla u- 

the world. lEA Study^ of ’ Readinlr' reading around 
International Associafton !!u ^itoracy. The Hague: 
Achievement f°r the Evaluation of Educational 

^nd M* Mojrcran ta ^ • 

Schools: A Comparative ’Analysis . ^i^®^acy in Irish 

Education, 28 , 1 - 101 . The Irish Journal of 

Mullis, I.V.S., j. R. Campbell, and A e Eo>•e.^- 

NAEP 1992 Reading Report Card for S . 

Data From the National and Triil stat/tl''°'' States: 

Department of Education, National^r^^f Assessments. (u.s. 

Statistics). WashingtoA D c " TT r Education 

Office. snington, D.C.. U.s. Government Printing 
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PART III 



COMPUTERS IN EDUCATION STUDY 

in two^Sta^s^°”?he®??ri? study (CompEd) was conducted 

data ?n ^ first stage of the study, which collected 

co^nniLi ? ' focused on "...the extent and availability of 
p ters xn schools; how computers were being used* the nature 

about computers; and estimate of SleSs JLt 

n ^ curriculum, and tt^hoof 

rwKiSct^r^- 

1992, "SagI 2°'’inSi3Id^f§et°oriSS 
knowledge anS 

computer education in grades 5, 8, and ll (i e the 

3“v ?hf f >T' education) . This report momsSSrs 

1 -i ^ from the stage 2 questionnaires. Appendix A lists ths» 

12 countries that participated in stage 2. ^ 

The lEA is planning a Second Information Technoloav in 

T^li°stlXl th’ • * P«3“t"forS;3"3S;eiSpment 

or case studies and the required "core" of a survey has been 
is^possible^that^thf°^ collection has been announced, but it 

l3r‘’S;;"ii%Sri93^IS3o?'' available iA time 

IPD Items Recommended for SASS 

Computers in Education Study is of particular 
interest in this report because it contains extensive 

teachers, much more than is 

found in the other two lEA studies considered. The items address 
teachers professional development related to the implementation 
f computers in educational practice. Table iv lists the 
subjects of the IPD-related items that are recommended for 

1999-2000 SASS along with the questionnaire and 
Item number where each question can be found, in the ^2^1^ th^ 
questionnaires are designated as CETQ for Computer Education 
Teacher Questionnaire, PQ for Principal (School) QuestienMire 
and CCQ for Computer Coordinator Questionnaire. It is important 
to note that the CETQ was sent only to secondary schools sinc^L 
IS unusual for elementary schools to have a computer education ^ 
teacher. Instead, fifth grade teachers who userrLmpu?er ?Sr 
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T V 

RECOl^NDED ITEMS RELATED TO IMSERVICE 



f'RAMEWORK CATEGORIES 

ATTRIBUTES 



PROFESSIONAL DEVELOPMENT 
QUESTIONNAIRE AND ITEMS 



Computer Education Teacher-Need 
for Training 

Knowledge and Skill Level 

Instructional Problems 
Experienced 

Perceived Need for Training 

Topics Taught in Teacher 
Training 

Topics Taught in Computer 
Education Lessons 



ll^CETQ: 


Int'n. a’ 


IICETQ: 


Int'n. B 




(part) 


IICETQ: 


20 (part) 


IICETQ: 


Int'n. c 


IICETQ: 


Int'n. c 



Time on ipd Activities 

environment 


IICCQ: 


37 


School 






Computer Coordinator 

Availability and Type 


IICCQ: 


35 


Availability of Training at 
School 


llCCQ: 


34 


Support for Training 


IIPQ: 


11 


Coordination among Teachers 


IIPQ: 


5 


Teacher's Control of Resources 


IICCQ: 
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questionnaires for grades 5 and 8. ^ found in the 

The items listed are from the ii ^ miAe> 4 -<> 

Items A, B, and C, which ar^ fro™ ^ except for 

Education Teacher Questionnaire These^ if Computer 
international report (Pelgrum et‘al^ 1993 ^^ found in an 

not survey computer education teachers * United States did 



respond to the CETQ 



inst^ctional purposes were asked to 
questions. 



use the CETQ questionnaire°in°i 992 *'h^ United States did not 
teachers. That is no lono*»i- -i-k i^ecause few schools had such 
schools ths£ do nit still sre 
In such schools it would be imooT-t... education teacher, 
questions to individual! Sho tim CEia 

teachers in oth“ dlLIlHnlrT f 
mathematics also teach computer education olurse!.' ' 



Recommended items that are Not IPD-Related 
Related^^Certificat^on^p^^^ that are not IPD- 

Percen?agfof |iudei?s Education^ 

is recommended SecaSe l^reStef tf if 

^areaTisr - 

in education. A copy of these fte;ru\^“i|3!d“!l !!p!!S?fl!" 

TABLE V 



^TCC^ENDED ITEMS THAT ARE NOT IPD-RELATED 



framework CATEGORIES 

Attributes 

Teachers 

U®*^'tification Requirements 
Include Computer Education 



QUESTIONNAIRE AND ITEMS 



IIP: 6 g 



Students 

Percentage Receiving 
Instruction about Computers 

School Organization 

Computer Coordinators' Activities 
not Related to ipd 



CCQ: 28 



CCQ; 37 a, b, d, e, 
f/ and i 
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The following section describes the items in Tables IV and V and 
discusses potential analyses using these items. 

Potential Analyses Using the Recommended Items 

that heavily on a major international report 

recommended IPD-related 

Students and Computers: A 

Cross National Perspectxve (Pelgrum et al,, 1993 ) —is the first 

second stage of the CompEd study. The analyses and 
findings described here, unless otherwise noted, 

chapter entitled Educating the Educators; Training for Teachina 

l?nd!nof ■ The policy' relevanie^offhr * ^ 

iteffls in SMS?**®® **’* benefits of including these data 

Need for Training 

To determine whether there is need for more trainina for 
computer education teachers in secondary school and for teachers 
in elementary school, the CompEd study used questions about 

problems%Sei?enced? Ld 

concerning need for more training. To determine 

"training would be most useful, teachers were 
asked what types of training they have already received. 

Level To measure teachers' knowledge about 
on how to use computers, item A in the interLtional 
teacher questionnaire includes three self-rating scales: 

knowledge scale: 9 questions about knowledge of hardware and 
software, e.g. What ••file extensions'^ are. The teache? was 

statement ••! 

know...^^ for each question. 

programming scale: 5 questions about programming skills, 

e.g. storing data on a disk drive. The teacher was reauired 
to answer "yes" or "no" to the statement "I can mit^a 
program for...^^ each question. write a 

capability scale: 8 questions about the ability of using 

processing a^d compSL 

assisted instruction. The teacher was required to anLer 
••yes^^ or ••no^^ the statement ••! am capable of .. ?•• 

on the three self-rating scales for the computer 
education teachers m lower and upper secondary education and for 
all computer-using teachers in elementary schools are shown in a 
bar chart (p. 75) for each of the three rating scales. The 
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median of scores on the three knowledge 
self-rating scales (percentage marked items) for ^ 

coSntrieJ teachers using computers. In a number of 

h?ah^«i upper secondary teachers rate themselves verv 

high on the knowledge scale and the programming scall ^ 

Experienced in Using Computers The long list of 
problems used in the CompEd study includes two that are related 

development: (i) teachers lack toL!edge/sk^^^^ 

instructional purposesranr?!) 

® °PP°^^nities for teachers. Teachers were 

p?ob?em i ma?or%rnh?''®^ was a mJnor 

proDiem, a ma^or problem, or not a problem. The data from -i-hoc^ 

terms^of%h” in bar charts comparing countries in*^ 

ex^iOToed%ach°of ?hS f (““Pnter education) teachers who had 
experienced each of the two training-related problems reifhor 

minor or major). The data, which ale for 1992 shoS thS ^JLn 

in which teachers consider that trainina oroh?s»me: 

olooo???oJ ? training.) Across countries a considerable 

proportion of the (computer education) teachers indicate a lack 

also"insufficieS?\''® computers for instructional purposes Ind 

Sould bJ ulifi? Jo opportunities, which indicates that it 

would be useful to organize inservice courses for these teachers. 

Teacher's Opinion of Training Needs Teachers were asked for 
their opinion related to computers, one o? thnSalJs in 

Siffsc^t:” need. ?^ere in 

^changes ^®®^ myself informed about technological 

^mnro^^K^^!^® take part in a computer course to learn 
more about computers 

3. Inservice training courses about computers should be 
made compulsory 

^ ^aids^*^ learn more about computers as teaching 

5. I do not mind learning about computers. 

This item asked teachers* to check one of the following 

^h® United States did not administer the teacher 
^estionnaire, but did include this question on the prinSipIl 

Sm|M°s?:i” " =™<>-tion for participating in Stage '^T^Slihe 
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Datl fro.. thiI |!4sUone«'d?sola«J agree, 

each Of the thrle levels of ed^Sw^n^o? 

a?ke'SLd°^j=®;ss5“p"“i 

topics, , 

of topics included in teacher trainii« ^°P^cs). The mean number 

it ?«tu"?atSr?lnacr» 

Topics Taught in Computer Education Lessons The list a. • 
covered m teacher training were also inn ^ ^ ^ topics 

teachers about what tonics st-o r-oxr«>. ^ question to 

practice. For eaSh le?e?o? schoo^TJf their daily teaching 
percent of topics covered in tT-»inv«”^ and each country the mean 

teachers, given the computer topics taSaht^in education) 
computed. The results show tha? a taught in the classroom was 

in the lessons on computers were Lso’inc^uded iJl\Srt?;i°°''®’'®‘* 
courses teachers received. Looking at the other"rat?n^’^*^”i"® 

?hr«^le^°?opLr;aSght1„‘?Sr%^^^^^ l«s°4ns?“iven 

in a nuSber of ?oSntriel e i<^ *'>“"« that 

training cou^ief^Saf SaShe?i JicLvf included in the 

imply that care?ul^considi?aSon results seem to 

training for (compute? educating included in future 
teacher! tend'to TiSh ttHopfSi 

in the lessons for their students. their own training 

School Environment 

Computer Coordinator: Availability and Type in addition 

support from outside agencies, support inSL the sn^oi? • . 

important and it would be logical for such sunnnv-i- *■ also 

the computer coordinator. Item CCQ:35 aSL whethL 
someone on the school staff who coo^dinaJel ?eacSe«^ ® 
instructional use of computers and/or helps other tee^h 
computers. Eight options are providL includinra ?n?? ^ 

national report for CompEd ( Anderson, 1993) . Da^ari Reported 
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of education for each of the countries and 
for four types of coordinators: full-time coordinator 

“"ly a'small 

°? =°“P“tef-“sih9 schools in the United States 
reported having no coordinator: 13 percent, 9 percent anr^ 

for elenentar?, lo2er-seconI“y?'anS upLr- 

relatfd’^to*the°^®’ ?'® Person most frequently coordinating tasks 

computer in all schools and for all 
three populations was a teacher /coordinator. 

Computer Coordinator: Time on IPD Activities: item CCQ37 asks 

the computer coordinator "Roughly how many hours per week on the 
average, do you spend in the following wajs?" Two of Ihe wa?s 

helping teachers: c) Training or helping ^ 
to use computers, and g) Writing (or adapting) 
instructional software. An additional way, h) Developina vour 
own computer-related skills, is also a form of staff devIlopSJnt 
JJJJ® of coordinator time spent on primary ^ 

coordinating tasks during 1992 by type of task, by country bv 
school level are tabulated in the U.S. national report (p^'52f 
Coordinators spend more time helping students than they do ^ 

teachers or providing computer-based 
United States at each of the 

thiir coordinators spend a smaller portion of 

teachers than do coordinators in the other 
countries in the study. U.S. coordinators spend even less time 
developing their own skills than in helping teachers and lesi 
time than coordinators in any of the other countries. 

Training at school item CCQ34 in Appendix C 
lists seven tpes of teacher training and asks the cLput^r 

available for teachers eitheroSside 
Bar charts for each of the three levels of 
schooling show the availability of training as indicated by the 
computer coordinator of computer-using schools (p. 83) . Across 
S*'® available types of training Lie int«duSo?y 

'^®® application programs, although 
some countries list other courses as equally or more imnortant 
Data for the USA are available only fo? upper 
education, but at that level the availability of training is 
uniformly low for all types of training courses. ^ 

Agencies that Provide Training Support item pqh asked 
Principals to indicate which of the following agencies provide 
training support: Ministry of Education, local educational 

authority, parents, universities/ (teacher training) colleges 
teachers of other schools, teacher associations/other ^ ' 

institutions/resource centers, and business 

SUh ^J® of principals of computer -using 

schools who checked each agency giving support in teacher 
training is tabulated by school level and by country (o 85^ 

Across countries the agencies most important in providing support 



i 



support institutions/resource centers and 
local educational authorities. In the more centralized 
countries, Ministries of Education are an important source of 
support for teacher training. 

Coordination among Teachers and Teachers control of Resources The 

sources in this section (Pelgrum, 1993; Anderson, 
nnHi-iifJ? ^ contain data on these items. Two more recent 

5 (Pelgrum and Plomp, 1994; Plomp et al., 1996) may 

include data and analyses. The lEA headquarters office in the 

would have information on whether the data have been 
published or could be obtained from lEA. 

Teacher Certification Requirements Include Computer Education 

• 1 ^ ^ available for this item. Possible data sources are 

listed in the previous item 

Students Receiving Instruction about Computers: 

report (p. 77) provides data on the percentage 
of schools offering students an opportunity to learn in a 
computer course in 1992 by country within grade level. The 
p®rcentag®s for the United States were 20 percent, 46 percent, 
and 48 percent for grades 5, 8, and 11 respectively. The 
percentages for the Netherlands for grades 5 and 8 were 
approximat®ly double those for the United States. It should be 
?who CCQ:28 asks the question in a reversed format 

have the opportunity to learn?). Percentages shown 
are 100 percent minus the “not” proportions. ^ 

School Organization 

computer Coordinators' Activities not Related to IPD The source 
of country data for this item is discussed above under Computer 
Coordinators' Time on IPD Activities. 

What Impact Would the Recommended Items Have on 6ASS 1999-2000? 

Including the CompEd items from Tables IV And V in SASS 
would require additional questions in the SASS Principal 
Questionnaire for schools with grades 5, 8, or 11; a new Comouter 
Coordinator Questionnaire for use in schools with grades 5 8 or 

11; a new Computer Educator Questionnaire for schools with 
grades 8 or 11 and additional questions about computer education 
"the SASS Teacher Questionnaire for teachers of 5th arade 
students . ^ 

of ^he difficulty of adding new questionnaires to 
SASS, an alternative procedure is considered that would eliminate 
the need for questionnaires for computer coordinators and 
computer educators. The computer coordinator questionnaire could 
be replaced by changing the teacher questionnaire to a teacher 
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and computer coordinator Questionnaire an 

beginning of the auestionnaino item near the 

serve as the computer coordinator?^^'^- question: Do you 

possible responsfs: ff ?no« 2k?p to 

"yes", respond to the comouter teacher questions, if 

additional question: Do yol telch questions plus one 

as computer coordinator? ^if Les^ addition to serving 

questions, if ”no” th^ ' proceed to the teacher 

questionnaire. ' Puter coordinator has completed the 



schools secondsry 

procedure used by 1^ ?or extending the ^ 

fifth grade teacherrwho usiH ^ ^ schools, which was to have 

purposes respond tr^e CETO o^eS?’?*’”'^®’' instructional 
some appropriate point in^the^eacher*me^< ® 
be an instruction: if you teach there would 

computer for instructional ouroLS f' ' °r ii and use a 
question, which would be th? U 

recommended CETQ questions Jf JL 

would be the first ite» following the wScJ°of S et^’ iti^s?? 



useful‘*infOTmatiM%bMt t^aShe?“ kno^led*’®'^®h‘'°“^‘^ Provide very 
how to use a computer; thei? ne^?.^^2S ®‘^I® on 

they think they lack knowledge/skills abonr training; whether 
instructional purposes; and whether thav ^ computers for 

opportunities for teachers to be consider the training 

provide information on SS commute? 

teacher training and the coSSSt?? their 

students. The disadvantage of this teach their 

international data for- »i w Procedure is that 

only for fifth grade teacherS^^ if^ available 

captures a sufficiently large ’number of f?Ti sample 

education teachers among the teach??® computer 

there would be comparable international in grades 8 and ii, 

CompEd study. international data available from the 



« 



Data Items in Both SASS and CompEd 

CompEdf %r?nrs?^of";??ncip:^"^^^^^ ST°" 

number of students enrolled in school anH teachers by subject; 
of the grades 10 , ii, and 12^ number enrolled in each 

students; and highest degree 'obtains»?^?^° classification of 
teachers surveyed in ComoEd and fny computer education 

teachers aMong'^the'sa^^Jff education 
be useful as a classification variahl2 ®ight 

differences among computer Sura?ion t.i^w°°”*’r^"9 
in Table IV that relate lo coS^Jereduc2?on 
be necessary to check with the^EA h2fS^arter^?f 
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whether country data are available since neither the 
international report fPelarum . 

(Anderson, 1993) contains®dati orhighest dSg^i^ attained 
computer education teachers, or indeld on a^ of ^ 

common to SASS and CompEd. ' ” items 

Items Related to Telecommunications Eqpiipment 
teachers'°SIe of%d™ScL®^e?Lo™ul:f 

be useful to V®^®°°®®^”^cations equipment, it would 

^ hof tLcSejrisf nSw^Wna Queitionna?« 

telecommunlcaSon! thS advanced 

IxSni^Ii"' deveLpf Sjs^?opIc''mo?e°^ 

could also formulate Question^ ^roup 

?L°S?Ee%1„^??e“n“SS Centr^ S2*lo°naridui^^ 

Items in SASS. benefits of including the 

Need for Data on ipd for Use of Computers and 
Advanced Telecommunications Equipment’ 

politically and by the Department S EdScatio^ A 
with a discussion of the iaportaLfo? IS the L^o? 
computers and advanced telecommunications equipment. 

The Use of Computers in Education 

unanswered questions about ^th^role^tS^mompSteJs^a^^ 

that paper is a broad recommendation toa*”ksl°°TcTud\^^?"® 
Items, however, it did not provide detail specilying the iteSsf 
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education. The percentage of 

n»Ss%"% ‘if f i?"> • “ 

billion a"'* 

effec??v2„^Sr;f= 1 °^-'^ <=°nlirned aboul tL 

they improve teaching and learning. schools, and how 

iS^tSrsfSSoS*”'’"'*'^” °* Adv«.ced Telecommunications Equipment 

prop^:L°\j%?2?iAr^^^^^^ 

Presidf“l “I 

education technology, the 

ttfeSSal^^ frerof°?r*'"^ designated educa?iod as 

Laboratory (NCREL) . The laSratd“‘'TOs rpiOTSer“?S’'to“Lblic 
Broadcasting System in using satellites to deliJL Jideo-L^^S 

orodu? 2 rt° 9 ?^ programs, m the past five years NCREL 

to tflo programs, which were delivered free via PBS satellite 

to the more than 23,000 public and private schools in ^ 

region (U.S. Department of Education, 1996). 

More recently the NCREL has established two new technoloov 
based resources: an Internet site called Pathways to sthool 
Improvement and a national Forum on Educational^Technoloav 
The Internet site for the NCREL Pathways project is a 
^navigating" tool designed to help educators accesi infor™«^-ion 
tailored to their school improvement neelS! 

would take a mathematics teacher only an hour to fi“ th 4 i^test 
on proven practices, download lesson plans and hands-on 

collefguel (Kobe?? " 

p” iinth? ' accessed about 3,600 times 

Forum on Educd^iondi TGchnoloov is i 

iZl^iT 1° "" extenddde ?Li?edS "" 

educational technology and as an "interface' for users of this 
knowledge base. Among other information, the knowledge Lse wm 
include information derived from the experiences of state and 



formulate^technoloS^policies^"^T^®?” programs and 

policy doBains (H.s. DepartBeAt of Education, 

providing universal access to technology systeBs; 

• integrating technologies into curricula; 

^^and^®”^"® =°">““"ities of practice and partnerships; 

examining regulatory and management issues. 

profeIs?onS"dS;eJop“"? ^oSL“%alh"=’'"^ video-based 
provide OERI with an impa?till aS^eSment^^^^ Forvm would 

as information about equity in accelS Program use as well 

geographically and by sociLconom?? I these programs 

and their stuLnts. characteristics of teachers 

Of eduSatiSn'"?LhmJo|yf® RSpresIntativerof”^^^"® i'"P°rtonce 

(Australia, Canada, Mexico . ^ several countries 

Taiwan, and the United sta+-oc\ Micronesia, 
this subject agreed that "Adeauate ^ recent meeting on 

needed to preoare stnrfoni-c -p ^ , training in technology is 
1996) . students for the world of work" (Ande?ion7 



TefeeoBBunlcations^Equl^Mt *** ®°“P“ters and Advanced 

is an^in&f °epecl*’of“lhe1uS:ri:?r technologies 

equipment in the schools, little is k^odn 
large gaps in the U.S. system o? 

more time to become conversant with ^®^ctiers need 

lessons that integrat^the compu^S ?n to plan 

to learn about computers. (AnL«on 199 ?? th ^^^^''ities, and 
of special interest because^?? looked cfr^i,’,n study is 
computers and because it found that U S teach^y?\^^^i ^®® 
opportunity for such IPD than had less 

students wire mor^profLieS th??u ? whose 

computers. proricient than U.S. students in the use of 

and Ploinp (1993) stress +-ha+- « ^ i_ 

ultimately the ones charged with thl 
in educational practice Ind therefore 'ed^cSi^n^'of 
educators- or teacher training is the 



lfttTr.l: coi"2teWSe??^S?,r 

the introductlon’^Sf*lOTpSters*in^schoSls^b “Patent aspect of 
teachers did not use because most of today »s 

secondary school and many of them^did^nL'^r^® elementary and 
education as part of thefr- «>-I ^ receive computer 

however, less tSan ha^f training, m 5.992, 

introductory computer °course avLlabl^'^f^^^®^®® reported 
(Anderson^ 1993 n course available for teachers 

to take inservice^compute?^loiSes^thfl!®d® have less opportunity 
Germany, and the Netherlands aJd a^miah? Austria, 

in these countries are more coSouteJ-kn^ST S® expected, students 
students (Anderson^ 1993) , ®dgeable than American 

status°of hd“j;ced\eLcoSJSilLtioS''ln"^^ **® 

secondary schools, nearly tm-thlrts oJ ^ elementary and 
Cited lack of or inadBcuatelv surveyed schools 

awareness regardina wavs tn staff and lack of teacher 

equipment as JSde?.?!® telecommunications 

school's acquisition^f advanced “aior barriers to the 

(NCES, 1995) . telecommunication capabilities 

Benefits of Including ipd items from compEd in the «j,-2ooo sms 

i9S9-2o?rs^i irSciuiH^s 

??p°es‘ ^njp1?t%"eer^“!S“Le°d^ J^d^ 

IS true for all lEA surveys) it hfS survey (this 

findings about the status^of 'profLsionfl"dL^?^^ to interesting 
computer education and tor 

between countries iripD^iS^i?" °* ^“^^e differences 
policy makers, lo^ e”Spl^ da?S ?roS t° 

provided the basis for recomTns»nHJ<-f^°“ CompEd study (a) 

needs of teachers, (b) made it possible'^to'^^n"^!?^ training 
position of a country with respect to th*» ^he relative 

training and support for ^eaSe« (1) 

extent to which the computer was inteirSJoH ^ '^ ? measure of the 
teaching, and (d) made it •" classroom 

of teacher training to actual classroom ^relationship 

Second, including CompEd IPD auestioncs in cae£ ^°®P^ters. 

make it possible\o mLsuif "mf^| 

to the amount and character of computer IPD 1^ thS "related 

from 1992 to 1999. Third, it would n™ 7 f ci United States 

their IPD in 1999-2000 with tha? of o?J^J ‘S compare 

And fourth, although there would be s^tn y^rfd^J^erencrl^^Ae 
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data. States could compare IPD for their teachers with that 
teachers in other nations at an earlier time. 



of 



In summary, the importance of including items on IPD for use 
of computers and advanced telecommunications equipment is 
supported by the combination of rapid growth in the use of 
computers and advanced telecommunications technology in the 
schools, the essential role that teachers play in their effective 
use, the inadequate training in their use that is available to 
teachers, and the national will for U.S. students to match the 
tech^'^l”'*^”^ students in other countries in the use of these 
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PART IV 



THIRD INTERNATIONAL MATHEMATICS AND SCIENCE STUDY 



fTIMSs?® Mathematics and Science Study 

InJerni^ion^? in 1994-1995 under the auspices of the ' 

countries \ 'rho 'ttmcc ^ 4 . j i (Appendix A lists the 

«-uuntries.; The TIMSS study also explores students' 

ilSiLpf SS& 

S?jtesy.a°L^?Ser?^SSron 

for thf ?h?rt^e;-Jea?-^Ids ' nine-year-olds and grade 8 



special strengths when compared with 

U s Nat in o£ achievement. According to the lEA TIMSS 

U.S. National Research Center fl995) these st^on«^-K^ •• 

fna?vs?s"^r""""-^ 

exaJne their S«uen=es o^ J^udSnriia?^! “f 

Identify variables associated with high JiJIis oJ fnK? • 

mathematics and science and will endel^o^ to explain ivltemic 

othe^°T?a^®^^°® influence educational performance^" Like 

other surveys, the TIMSS design will permit analvlis of* ?ho 
intended curriculum, the curriculum as actuallJ deliJeJed L ?ho 

«h?^eed^Su^?Lu1S:?f°°”' learned^hf 

in re™ Classes, and case studies of education policy issues 
in Geraany, Japan, and the United States. One of the foL 
investigated in the case studies is teacher workina eondi i-i 
Appendix D provides more detail about the components of i^MSS®' a 
related activity consisted of assessments for th?ers?fteJ 

■”Sr=o:pSL°s„\^s?ir*ih°er°* 



ODDortu??Jv J displays the complex model of educational 

tSI desJgnyase/eLri? 

developmen^of suLSeJ^o^ 

collection nio™ i” conceptual framework) to guide data 
TIMSS U.s/National Research^Center^'^iJS??’^^^ development (lEA 
(1995, provide further dis=uss!Sj“i Jhrioncfp^Saf f 



Sy%tm 



Sdiool 



riiiifoom 



Student 




Wiat are ttudents 
expected to kam? 



Wliodelivcn 

the 

lasfrucdon? 



HowU 

mstniction 

Of^ganizod? 



Whet have 
etudcAU 
learned? 



Figure 1. Conceptual Framework: Educational Opportunity 



Source: lEA TIMSS U.S. National Research Center ( 1993 ) 



Explanatory Variables in TIMSS 

associated with the achievement results® in iweJtiMtLa^'o i ■ 



For our purpose, identifying ^ere“2ri"?orSrip^’'t^ji*’^^®- 

anf?i;f ShSorg^SuSL^SeH^rLtf 

mathematics anrsciSce eduS?iL'' °" issues in 

teaching mathematics and science ' TL“2ehcni about 

activities, inservice educa?icrand «SiSScrra?es?°"‘’“''" 



selection of items for 6ASS 
Prom the u.s. Version of the TIMSS Questionnaires 

analyses conducted by the TIMSS Tntor-na^i’ Based on the 

preparing the first puwLaUcL Sf SmI^scM 

of these items were "ejected as probUm LSSs^"''®” ' 

Recommended Items That Are IPD-Related 

reccm^endS”lcr1^^is?L"?riAll 
«pirt?"?he is:; srSgSLSs; 

snsSrS: SI :isi?igSs:ssf:S'TS^^^ 

SeSlI-air^S IleiSulS^lS^^^ 
a|pSS?S|he SSliSnfiSS^^SeM::: S "S 

the following section on Rati onlll L discussed in 

iSmf'^fSmShlV^S ®ach itSS fI? 

;s:n%is:dS:SeSaSSs"i:aSs::srsSdSSsSn^"^“^ 

(Population 1) , and 7 s 8 (SSfalfcl I? "SeS SSlI I ‘ t 
questionnaire for the 12th grade (Population ?f ?? teacher 
school questionnaire should be addLssert^sohAo^ S® • 

IcplSllSs!*'"" thl Sa%1sScrSe°\:SS^""”‘“^ 

matheStilSflrShStSchirSleSiolSirSLdSl"^ 

for populations 1 and 2. “hl ileS il Se ShS?^ are the same 
are the same for populations l and 2. PopulatioiS nSSSSSS 
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item on principal's activities (numbered differentlvi hni- 

no .aaitional IPO-relaSd" were 



TABLE VI 

TIMSS ITEMS RELATED TO IPD 



Ouestlo nnelrn^n;;^;' 

Attributes 



Teacher Qualifications 

Inservice Professional 
Development 



Environment 

School 

Principal's Activities 

School Organization 

Teachers 

Cooperation and 
Collaboration 

Joint Curriculum Planning 

Meeting with Parents 



TQM2“: 


12f 


SCQ2“: 


11 f, g, 1 


8CQ2: 


10 


TQM2: 


13 


SCQ2: 


13 f, g, h 


TQM2: 


12e 



The United States TIMSS questionnaires include three addition;,! 
questions related to school environment, but thS a?e no^ 
recommended for inclusion in SASS since international 
not available for them. These queSSIL 2e?ricor?LS 
parent cooperation and TQM2 items is and 19 on^observina^ot hS,- 
teachers and observation by other teachers, ^ other 



*® TQM2 stands for Teacher 
Population 2 (eighth grade) 



Questionnaire, 



Mathematics , 



11 

grade) 



SCQ2 stands for School Questionnaire, Population 



2 (eighth 



Recommended items That 



are MOT IPD-Related 

for IaIs! 

S3».s2=s;m 

1 ^“'“ S”«.. 

been reoomendenor fSclSion fn 

Reading Literacv studv SkI 2- section on the 

promoting academic achLvement geSSall? factor in 

here because it would also h«» rS •!«•*- item is included 

s~~s ss.- 

better understanding of how much SaSbimy exij?s*’lrif^/ . 
students or 

in communities with differing degrees of u^toAility? 

TABLE VII 



recommended items that are not IPD-RELATED. 

FRAMEWORK CATEGORIES 



QUESTIONNAIRE AND 
ITEMS 



ENVIRONMENT 



School Resources 

Computer Availability 

School Organization 

Total Instructional Time 



SCQ2: 



SCQ2: 



Teachers 

Time spent on School-Related TOM2* 
Activities outside the Formal 
School Day 



15 a, c, d 



19 



12 a-hp 

except e fi f 



The questionnaires for Populations i and ? -a. 

computer availability and tima spent on schooi-rJia?Sd 



activities but the population 3 questionnaire does not. The 
total xnst^ctional time item is in the questionnaires for all 
three populations. 



Potential Analyses Using the Recommended Items 

TS.S Unlike the Reading Literacy Study and the Computers in 
Education Study, TIMSS is a very recent study — the first 
publications of international data were issued late in 1996. To 
make the TIMSS data on school achievement available to policy 
makers and the public quickly, these publications are limited in 
large part to providing cross country comparisons of the data for 
many of the TIMSS items. Analyses to show the relationship among 
the various factors that support high student achievement have 
been left for later publications. 

Availability of TIMSS Data for Use in IPD-Related Analyses 

major publications that release international data from 
TIMSS are now available. The first two focus on international 
comparisons of student achievement in mathematics and in science 
in the middle school years (Beaton et. al. 1996a and 
1996b) . There is also a U.S. national report, Pursuina 
Excellence: A Study of U.S. Eighth-Grade Mathematics and Science 

Achievement in International 

Context that reports data from the TIMSS questionnaires (U S 

Education, 1997). This report also uses data from 
the TIMSS case studies in Germany, Japan, and the United States 
TIMSS Curriculum Analysis, which analyzed more than 
1,000 curriculum documents for mathematics and science. 

Three publications based on the Curriculum Analysis Study 
have been issued: a cross-national report for mathematics and 

one for science (Schmidt, et. al, 1997a and 1997b) and a U S 
national report (Schmidt, et. al., I997c) . The three curriculum 
reports provide extensive information on the intended curriculum- 
-what IS in the curriculum, what students are expected to do. and 
how decisions about curriculum are made. They integrate data 
from the curriculum analysis and data from teacher questionnaires 
on topic coverage and instructional practices. 

There is also a publication from the Survey of Mathematics 
and Science Opportunities (SMSO) . In the SMSO, information was 
collected about the curriculum used and observations were made of 
instructional practices in science and mathematics classrooms of 
nine-year old and thirteen-year old students in six countries- 
France, Japan , N«prway , Spain, Switzerland, and the United States. 
The report (Schmidt et. al., I997d) provides information on 
international differences in curriculum and on observations of 
instructional practices. 
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student achievement differences in 

related to IPD are the teacher JnrfJXKi ®a3 or sources of data 
administered in connection questionnaires 

students. connection with the achievement tests for 

analysis''?Lri“5i?fL^mZT^ 1999-2000 are available for 
reports are scheduled for oublicar^^°^^^ TIMSS. Several 

international reports and u s including 

performance assessment and on reports on the TIMSS 

for the two additional student oonulation achievement 

students enrolled in the f iSl S^.r ^9-year-olds and 

Reporting plans for TlSlq ? f secondary school. 

findings and methodology used in^the'^vid®^?^^®'^ reports on 
mathematics instruction «nd videotape study of 

One of the case study reports will be^on^thf^°” studies, 

teachers in the thre4 coSrtries rtudLd 

certification and training requirements.' information on 

data. This'^report^will link^the ach? TIMSS 

mathematics students in the c;i-a.»-o ^i®vement of U.S. eighth grade 

from 41 ccuntrieC wCo KMSs'CCtCiSaJ • 

performance of fourth crade stud»ntf ® assessment, 

science will also be liCCeC "ethematios and 

possible to order the s?aSi a^S if 

achievement in science or mathSms^f!!^^ nations by student 

the characteristics of ipd in states%nd/o^° "‘^^® °°®P®^isons of 
students demonstrate hinh ^ \ nations whose 

show low achievement. evement and those whose students 

analyses will b^conducted^that^iill®\^^®Jh^^^^^ in-depth 
among the cultural, social attitwdJn®?®'^ the complex interplay 
factors that support hiah kudeiJ fiJ?^' instructional ^ 
have been announced. Conseauentlv in^«®”*®4?^' detailed plans 
and the items for which iTvteT*na'*--i nfonnation on the analyses 
the future is nrt avi?Lb?e available in 

on the analyses that wLe pianLd tte ilemrii®?^®' 

Sfs^^NJwlfrRisSarlh^en^erf^lllf^ TIMSs“uIa TIMSS 

publishir?epor?fsfncfarraig^^^^ i" 

researchers access to the TiMss da-»-f made to give 

Foundation and NCES plan to stimulate research® Science 

data bases, so numerous additional reoorts TIMSS 

can be expected. ^ ' papers, and analyses 



The 



This discussion Of available and planned reports based 
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analyses that^c^^be^experted^to^b?fo?t^ wealth of data and 

provides the reason for selectina^i?^ reconunended questions, 
available sources 

IPD-Related Items Recommended for 8A5S 

one of nine'pSts'of'*tCT°i 2 *iJ°the question, 

the teacher MPROXIMATELY >,^ Ouestionnalre, asScs 

on each of the aoti^iSs "®®^ *’®/®*'e spends 

five options: nOT^ leSs ?SaS ? i, <*®y> »ith 

bore than 4 hours, 'item l2f pertailJf't^wS?”®' “ 



12f . 



reading and development activity fe.a. 
SGinxnairs, conf© 2 renc©s, ©tc.) ^ 



se^ra^rreSd?nrf?lm"otSL*lro?eJs^ question because it does not 
and gives no information on development activities 

IPD.^ It irhJSevS? tte oSl?^?lSlr^^rf- °* i-fivldual types of 
directly. Although the 1993-1994 ^Iass addresses IPD 

related to IPD (Public Scho^ TlLut ,.®®"!!'^"® several items 

32, and 35), the information in TIMSS itSm 

from the SASS items rrmn^-l-tr « item 12 f cannot be derived 

interest “^aj^a^r addfUn^eS"?! f Ssi!" 

perSeerttS''s?sEiS3S£!T ni^er If'hours 

Xran and 

^^nida^So 3f?®lor“s?aS“an; tee""'" 

1.0*2. ^ Israel, and the corresponding U.S. figure is 

activities, onfyfo ur of"l^f Lt“?:;?JiL"!r"r|ro°?oSa""fo°J ^Iss: 

reported for the" teacher^ of'the*?i«ientat?v^ TIMSS are 

assessed. The responses to the s^ples of students 

do not necessarily represent all of the 

teachers in each of the counts io= I = eighth-grade mathematics 
a more detailed dfscu^^rro^lhis arpro?ch°." 
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f. 

g. 

h. 
1 . 



Giving a demonstration lesson 

Objectives with teachers 
Train?nrteacJ«r^“" Planning 



■' 1 th teachers is cne 

=haracteril??^i"iS!t=i^SK?in,“? aT???fl; ?L%°* 

ot°hi? s^^ra"ss^i^Ln 

support of inservice prSessioSl leadership and 

development activities or^Vh^VSV^-^ Personal professional 
teachers. BeVaVIro? tSis Pertains to those of the 

for SASS.) mbiguity, the item is not recommended 

or No) for each question. ^^®stions by checking one box (Yes 

Si.™; ;sg.-s;,s;.i°s.:?a sssn;! «" «■'• -> 

?Astructnna!"oaL''a;S Hs^s?"""^ regularly to discuss 

organisltion^hat trt fSppOTti?e^of“teSShe?S?®l''® °* 

b«n'"pub??SLffoJ°f“fi^°i““^' SSI iSe not 

thTlS; -1?LgT^Sh"^ShISt"IaSh^rSllSSIiI^^^ 

fSeT?eIp^lSSpt-In%^rSlvS.‘I-^ 

month, once a month, once a week two or^VhVf every other 

almost every day. ' three times a week, or 

••0pportVn??i2V\V'VeV?“??nVlleVV^^ ViV 

teaching approaches enable teachers to exoand\h^^^^°'^^^® 
mathematics, their resources fVr VVachiV?^ VVrS . 

this iten (p. x 49 and 
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neve? meet o? meet oncS/twinr! teachers who 

meet monthly or every other percent; 37 percent 

or three tiLra wee^ Sd s S™' Percent meet once, twice, 

range of countrierior Se LlrcSLo^’^ • The 

Hong Kong to 46 peroInwlr"SSgaS"In?'silv2?:/ 

hoS'S!” hlws“|er^Jeek't^i*noraallv“ ““"a APPROXIMATELY 

following activities normally spend on each of the 

are provided: none, less than*^l hour^^i^'*?°i options 

or more than 4 houri. One^rtL-^SiviMe^ iLlrl^Tek: 

e. meeting with parents. 

no time=o,less than l hour'= o?5, 1-2 hourS scores: 

&nd inoiTG thcin 4 hoiiT*e — c *r X«5, 3 4 hour's — 

s??s*pa?fn£routSsf2srf:^h^“i¥"^^^^ 

ire?-d\T!;3 "“r 

involvemSS^^rSchSIls^^In'dS?" -^® Parental 

educational problems posed by the"lack^f such'^^^^i®*®® 

ffsTSfXbJfms"f^?Je^|JJSo?LiT^T“"^ 

discussion of the Reading Lite?acy°study°a”?iTated^” the earlier 
parent cooperation with the schnr^ Vn •#-^ related question on 
school's eScatioLI princiofes oi support for the 

SASS. That discussion inclSLs two ?esL?ch f indil!®''‘^®‘^ 
cooperation is important in discrimi^at?n« LJ ^ P®^®«tal 

have not yet been published? ^ mathematics and science 

Recommended items that Are not IPD-Related 

availSLlS^“n"l\%S d 

ins%^uJffonS!‘’iimr5f^e"^^^^ 

information is available, however ® f?"*® 

mathematics and science classes (4ighth-g«de’'u°s'"°stud''^f® 
more hours of mathematics and sclenie inltr^ct^^;! ?lmrpL®?“r 
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Germany and Japan). The findings for 
mathematics and science are of sufficient interest to warrant a 
closer look at total instructional time. 

Data Items in Both SASS and TIMS8 

A number of items in TIMSS can be used to provide 

comparisons with SASS data, and some of them can be 

»D-related data! Data for some Sf ?SesJ 
Items (teacher certification requirements; age and gender of 
mathematics and science teachers; and years of expe?iencS of 
athematics and science teachers) have been published (Beaton et 

• The TIMSS school questionnaire and SAss 

lchSor"=?sdr,^"=^“'*? questions on geographic lS««ln S? 

ol, grade levels in the school, number of FTE staff bv tvoe 
and number of full- and part-time classroom teacL?s! ItLs more 

item school environment include a TIMSS 

^ primary responsibility for each of a list of 

activities (some are in item 45 of the SASS teacher 

Sfeci°sch?;^?! an item on shortages or inadequacies that 

provide instruction (some are in item 
47 of the SASS teachers questionnaire) . 

An item of particular relevance to IPD is teacher's control 
of classroom. The four parts of TIMSS item 14 in the TIMSS 

Population 2 (eighth grade) pertains to 
th?ee^of%h°”^^°^ classroom. The 1993-1994 SASS included 
TIMSS as shown in parentheses following the 

^ below. In this question teachers are asked how 

™ fonSsyr”®' ^ 



a. 

b. 

c. 



subject matter to be taught (SASS item 45b) 
specific textbooks to be used (SASS item 45a) 

money to be spent on supplies (SASS item 



d. what supplies are purchased (not in SASS) 

study of the effects of professionalization of teachers 
on their commitment to their teaching careers found that schools 

Of teacher classroom autonomy had Sghir 
i? 9 ?J teacher commitment (U.S. Department of Education? 

I important to understand the variability in the 

extent of teachers's control, e.g., by type of school, teacher's 
subject matter, and teacher's years of experience The ttm 99 
data for this item have not yet been published 
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PART V 



RECOMMENDED ITEMS: SUMMARY AND PRIORITIES 

SASS recommends 33 items that might be included in 

lnt£Aa«ona?"£atr" “--tion ' an?lhe"?hi?I 

described for most of the ite^s! L notS^fri^rt 

data for o^l?^40?^nd^il^the^most®^ (50 participating and valid 
“''T^ the most recent study, with data 

^es1?^;°SiJ2ci?rre?ft^f I; ^nSinf Lly one 

midway between the CompEd study^and TIMSS^wlth Study is 

of IPD items (two itemi di?S^^y^?el™ft^^PD^ fnf 3 !° 

S?to"da?f^S?i“??on"fri99f ?he 

Sa^a°?rom"fh’'^^°"® ‘=® prepLed frort£2'’?Sf-2^“ 

data from the RLS and the CompEd study will orobahiv Ho ttt ' 

eleven years old and TIMES data will be seier?ears'^o?l.'^“ “ 

survev®fiJ llll f*"®"® !''® recommended items in each 

itSST *’ questionnaire and for three ty^2s of 

direct measures of IPD, 

items related to IPD because they describe a school 
f Sf Siv“1c^Sor?^|fr^f a^"“ e Jf a°s%\ciated 

achfe«m2!f associated with student 



Each table cell contains three numbers: the first •»->,« w 

of items directly related to TPn th« ^ • ff number 

school environment JiSf ^Sd ^4 f ?rf?f?h»® 

gb?rcf°ns» 

III that modifies the SASS Teacher Questionnair** t«-> k« =.^2 Part 
and Computer Coordinator Questionnaire Ld al^o emLds ® 

"computer science", for SASS 1999-2000 it would bfdfirSblff 



none of the recoSda?LnriSrcSritLr«“adSpted^^^ “ 

TABLE VIII 

recommended items for each survey by respondent type 



QUESTIONNAIRE 

CompEd Schools 
with grades 
5, 8 , or 11 

Principal 0 , 2 , l*^ 

(School) 

Teachers (in 5 , 0 , 0 
Grades 5 , 8 , 

& 11 who use 

computers in 

instruction) 

and computer i, 3 , 2 

coordinators 

Reading 
Teachers (in 
grades 4 & 9 ) 



Science and 
Mathematics 
Teachers ( in 
Grades 3 , 4 , 
7, & 8) 



TOTAL ITEMS 6, 5, 3 



■SURVEY 

RLS Schools TIMSS Schools 

with grades with grades 

3, 4, 7, 8, 12 

1 0, 3, 2 



3, 1 , 1 



If 2, 1 



3, 5 , 2 



If 5, 3 



Response Burden for the Recommended items 

total response burden for differ'^ivh 
depends on the difficulty of the items anrt w ^ respondents 

respondents. The total L^deTlo^ SS ?? ■ 

not large since there is only one resoondent 
burden for teachers is consiLraLrSrgerSiSS ^SSr^re"*'" 



” numbers in each table cell represent i, 

r^urio xfo "V^hTnuSjr"orr^e„°/ n^orre\Hri 



order, 

items 
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BEST COPY AVAILABLE 



»“ teachers 

xn graaes 5, 8, and 11 who use the computer in their ciacseoe -f^v- 
instpctional purposes; six RLS items for gradeTand 9 rJ^i^r 
teachers; and four TIMSS items for science and matheLticJ 

“<^8. Teachers in gradS ^ 5 7 

Studies°^ihn!^?°"\^° IEa' ' 

Se?f while teachers in grades 4 and 8 would respond to two 

Sm 11° li^ComSId coordinators is also 

compuier tooS?Sa?o« questionnaire for Teachers and 



As can be seen from Appendices B, C, and D. most of the 

hSvfmo- ®*®^ to answ4r-:iess toaS haJ tS items 

the oa?tS S thf exceptions, 

SJckin« onf require only "yes" or "no" answers or 

? ^ three or four alternatives. The exceptions are 

Com^Ed ^^®“ 26. The Computer Coordinators ' 

Comp,Ed xtem. Activities not Related to IPD, requires an estimate 
of hours per week spent on each of six activities The pt.r i-f-om 

im2S??anSI"?“'’®"^ *=“ ®^3ht activitieriS"“der^l 

importance in work as a school principal, 

not be^oT-M^^^ f£ all 33 recommended items would 

not be great, should that not be feasible, the next section 
provides a rationale for prioritizing the items. 



Priority Items for Inclusion in 8ASS 1999-2000 

consideration of the relative priority of the 
listed in Table IX. Top priority obviouslv 
should be given to the 10 items directly related to IPD: Jix 

Items from CompEd, three from RLS, and one from TIMSS The next 
priority would go to the other eight items from TIMSS because 
they provide recent data for a large number of countrieJ? I 
possible exception is the item Time Spent on School^Related 

Outside the Formal School Day. 

be SsefSl be useful to teachers Ld might 

ne useful in clarifying variation in equality of teacher 

is S JS environment 



Is the item strongly associated with professional 
development? -«.wnai 



Does the item provide information that complements 
the top priority items? 



one of 



Is the item associated with high student achievement? 



Priorities for It^s Recommended for SASS 1999-2000 
Classified by Questionnaire 



ITEMS RELATED TO IPD: 



114 

1 

1 

1 

1 

1 

1 

1 

1 



1 



Teacher (and Computer Coordinator) Questionnaire 



Teacher 

RLS 

RLS 

RLS 

Comp Ed 
CompEd 
CompEd 
CompEd 
CompEd 
TIMSS 



Education in Reading 
Inservice Reading Education 
General Reading Interests 
Knowledge and skill Level 
Instructional Problems Experienced 
Perceived Need for Training 
Topics Taught in Teacher Training 
Topics Taught in Computer Education 
Inservice Professional Development 



Lessons 



Computer Coordinator 

CompED Time on IPD Activities 



ITEMS RELATED TO SCHOOL ENVIRONMENT THAT IS SUPPORTIVE OP IPD 
School or Principal Questionnaire 



3 

3 

2 

2 

3 

3 

1 

1 

1 



2 

1 

1 



RLS 

RLS 

RLS 

RLS 

CompEd 

CompEd 

TIMSS 

TIMSS 

TIMSS 

Teacher (and 



School Resources 
Community Resources 
Parent Cooperation 
Principal's Activities 



I or Training 

Coordination among Teachers 
Principal's Activities 
Teachers' Cooperation and Collaboration 
Teachers Joint Curriculum Planning 



Computer Coordinator) Questionnaire 



Teacher 

RLS 

TIMSS 

TIMSS 



Principal Discusses with Teacher 
Joint Curriculum Planning 
Meeting with Parents 



14fi 



The numbers at the left of the table sianifv -hh 
assigned to the item; -i" for top priority ^ ••2'^ fo 
priority, and "S" for low priority. 2 fo. 



priority 

moderate 



Computer Coordinator 

CompEd Availability and Type 

CompEd Availability of Computer Training 

for Teachers at School 

CompEd Teacher's Control of Resources 



ITEMS THAT ARE NOT IPD-RELATED 

School or Principal Questionnaire 



1 

1 

1 

1 



RLS 

RLS 

CompEd 

TZMS8 

TIMSS 



Books in Library 
Total Instructional Time 

Teacher Certification Requirements Include 
Computer Education *«cxuae 

Computer Availability 
Total Instructional Time 



2 

3 



Teacher (and Computer Coordinator) Questionnaire 
Teacher 

TIMSS spent on Setool-Releted Activities other 

than IPD Outside the Formal School Day 

Computer Coordinator 

CompEd Percentage of Students Receiving Instruction 
about Computers ow^uction 

ConpEd Co«PUter Coordinators' Activities not Related 

development. Four items were assigned priority 2 - ptc 

on Parejit Cooperation because it complements the TiMSS ^ 

professional development and a second pert^nS to Tsunofr^T^ 

assigned a low priority because it is focused c;oioi„ 
related coordination, whereas the TIMSS question applies'^to^al?^” 
coordination among teachers. The remaining items are ai<;o 
assigned low priority. Although some o^ the I?D-reLterschooi 

SXnvST ^ ‘“®" assigned middle and low p?l«lf5^ 

remembered that all of them are also associated ^ith 

regard «>s-^efore can also be uselSrirSat 



Ainon^ the items that are not TPn— 

TIMSS items that have alreSv 2™ there are two 

first, computer T”® 

variable in conjunction with the c2™2ph ^ t ^^^^sification 
Total Jiistructional Time whs;2 The second item, 

because it will help understand i-ho The CompEd item 

professional developneS? ?SL^?eff £” inservice 

it is highly correlats»rt tr-i't-vi the RLS item because 

used as 2® with reading achievement and could be 

rllltll ?o J?d! variable in analyzing the RLS dLT 

Computer ^^<?ucation^^is^assioned*^f^^rt Receiving Instruction in 

classification vSiaWe 2S2?a?ir r®^^P^i°^^^y ^ 

computer education. The remainina^i ts»m^ items related to 

that are not IPD-related items from CompEd and TIMSS 

could be u^ful irilenti?Jf„o Pfi°fity, but they 

teachers and coordinators can spe^d on IPd!®“® computer 



A Final Comment on the Recommended Items 
indicated throughout the paper the dSa w2uW ?InS 2>, 

in^i?:^?!oroTa’’„^S?^=re:5?ci‘ a sSmn?or:2?ir°''“r 
?sinanL^?o°nsnnt?? dif?n?nnc2s^p?nnir''''°®^f?"‘^ obvious 

fcr Placing crosS4LnlrT”SpLMS^?n" cSmtl^"!"""" 



PART VI 

providing context por comparisons op state and nation ipd data 

in SASs/particSlarly the'interactio^^ recommended for inclusion 
clear that it wil? be SoortanJJo variables, it is 

educational influences and culturai^S°°?”^f ® significance of 

nations and the stated context of the various 

schools) that LrcomLrS °r other groups of U.S. 

not measured in IaII ?r S; 

traditions that account for- f” ^^oiude historical 

and achievement levels cultural vai*^ structures of schooling 
expectations, moiivaiion aS manr=“®-' .=y=tems of rewird. 

In considering the importance of LteSior°?°”^S characteristics, 
influences, Bradburn fnd Giflort UssS? 

Sr!l|St°Sf°peSic;pS;ng"nS?i •■-..Should L considered 

fm;o^\-c%" 

judgments about the successes and make informed 

system is stresslT education 
Indicators: An Inter-naf?onf? » publication on Education 

Education, l9^af? Scka?ou^^^^ (U.S. Department of 

the indicators throughout this puSiSatioS. interspersed with 

fortUMte^ inSedy^Lcause^of"thi°"^^ education data is 
cultural context for sSltip!e“ouSt?ief’’®In"ISr‘n’'^rr°" 

r!ire"!“jri:Lr°ia"rif-'> 

would be most usefSl®in\h2r aralySeS th?'fo??‘’^ 

includes brief descriotion. nf following section 

report. descriptions of these publications and one earlier 



information on Teacher Preparation «.a Professional Development 

Two reports provide context for IPD data- a 

P«?fic i=oSom?“?Sop2af"^r=o™te^ inW°?Asla- 

Cobb, 1995), and a reM?t on inc»^3? . end 

the countri4s in thriS«pSn^S=?Sr?lDl5§i2rilf5?**="“= " 



The APEC Report 



raPEcT^S °^9anization for Asia-Pacific Economic Cooperation 
ocean! 

the United States\^^ ° Korea, Singapore, Chinese Taipei, and 
teacher recently completed a comparative study of 

^Darlina Hamm H practices by its members. The study report 

indSciJon” includes inf ormatio^ on 

and incentivel and participation 

proaraS forSa^h in professional development 

fhorrwidfvaJJet? members. The^countries 

for profession^ deielopnent® in-school tine 

provi e interesting and useful comparisons in SASS reports: 
the context of schooling 

lefche?s^anro?^!a\-®^°^^ characteristics of 

of teaching employment; and supply and demand 

D^oSram=f^®^K°® govemance of teacher education 

teacher preparation cSrriculun, diflerJnceS 
preparation programs, and links bitween tJachSr 
education curricula and student standards 

licensing pguirements: initial licensing, continuina 

requirements for licensure, conditions und4r which 
requirements for licensure are waived or altered 

policy issues and trends: current policy issues and 

problems; and policy initiatives ^ ° 

The EURYDICE Report 



The Education Information Network in i-ho tt • 

the EFTA/E^ Countries (EURYDICE) recently pubUsSefa report^on 
inservice training of teachers in the 15 European Union SoSntries 



that participate in the network and two EFTA/EEA countries 

(EURYDICE, 1995) . The Lecutiv^l^^ary of 
the report provides useful cross-national summary tables 

organiaation of "inservice 

the official implementation date of inservice training for 
teachers^^^' primary, lower secondary, and upper secondary 

main features of "inservice training” structures and 

bodies, type of organization, main training 
stablishments, status (university or non-university), 
training compulsory or training voluntary 

approximate share of budgets allocated to inservice 

education budget as percent of GDP, and percent 
of the education budget spent on inservice training (ranging 
in°No?Sa?)^ percent in Belgium and Finland to 2 perclnt^ 

teachers requesting participation in inservice training 
courses in 1991/92 or 1992/93 for each of four level^If 
schooling (pre-primary, primary lower secondary, upper 
secondary: teachers requesting participation as a^ 

the total number of teachers concerned, actual 
participation in inservice training courses 

In addition, the Executive Summary lists a variety of measures 
used to replace teachers attending training courses. It also 
includes a table presenting the main types of qualifying training 
offered by governing bodies or Ministries. Statutory leave is ^ 

larae^n«5?^o?^?ll during which teachers recLve all or a 

of tbeir normal salary. For each country the table 
shows the availability of qualifying training, the qualification 
awarded; whether it is awarded for change of position, promotion 
or enhanced status; and whether it is accompanied by a salary 
increase. 

nf . f^J^y.°?ncludes with a section on content and practice 

of inservice training covering several topics: content 

trainers, assessment procedures and the European dimension, 
mobility, and conclusions, it is interesting to note that the 
aspects of inservice training given the highest priority in the 

^ ° mastery of the mother tongue, learning 

and mastery of foreign languages and early learning of them 
®'*lbiculturalxsm and management of diversity in school ' 
populations, and knowledge of and respect for the environment. 

The 14 remaining chapters of the EURYDICE report are country 
reports with detailed information on teacher training 
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other Contextual Information 
Country Differences 



for Interpreting 
in IPD 



”5"^ ?®Pects of country 
than the two reports in the information related to IPD 

both educational ani cSlSlal“ontK? ai^cSss 

four provide in-deoth inf^™5?^ countries, while the 
education indicators. ^ nformation on international 



The TIMSS Encyclopedia of Education Systens 

Study (TlMsIf recogSind^thS^moort*^ Mathematics and Science 

interpreting international ® ^5P°^^®nce of context in 

for 38 countries that particioatS compiled information 

chapters^discSS tS flpoUtnci°tr^il 1«6, , the tlrU ' 
comparisons, and provide broaroattarnJ ^ international 
differences in structure, curriculum similarities and 

countries. The balance of th^ i' and assessment among 

national chapters, each of wh?nh consists of 38 

the country's geographic location^^°'^^‘^®® information concerning 
other factors ?hat Sa^rf Jearino^or^A Political syste^iSI 

contains a descriptio^ of thS nSioS?. chapter 

(governance, decision makin«^ nation s education system ^ 

structure) ;'deteurSn stee!;innSrt;‘’“S?*^^°"' 9”^® 

information on the organization^and extensive 

science. The chapters are sunniam *■ ^^fng of mathematics and 
from TOESCO, OECD, world 

The lAEP Report 

Servi^^^”^^^°® ®°^®nce?^cSnd^cted^by°thi°^^ Progress (lAEP) 

Characteristics and current cha?? unique 

provides information for a few coun?^^ country. it 

in TIMSS. In conjunction with th^^fir not participate 

and students to value learning (Lapointre^^air^gl^ 

OECD Publications on International Indicators 

OrganisItiirfor^EconomirjTOperatKn”^^^^ Innovation of the 

released two publications on educatiSn «bently 

Indicators and Education I^dcatlon at 

(OECD, iggea and l„eb, . This fSSa‘J“ 
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BEST COPY AVAILABLE 



countries (Korea, 

Sat" SrTsSlSSrS 

internationally and that ^ current state of education 

resources and educationSl"^JS?S4s2"?olSri"l6a"p."lK®'"® 

social anSeconomic TOrteSSI'^eScft?’^ chapters: demographic, 

human and financial reSou^Ls^ costs of education and 

Relevant io IPD: llSh?S indicators 

insStSfoni ErSSfoSeSS? ''°““ pSSSa?®in°|uSL"°"“' 

headteachers (includes professional ?°""^®®=*'ing activities of 
informal meetings between headteacheSMd°teJoh* ' ^^'’uency of 
entire teaching staff meetinas- and 5®' frequency of 

involvement in the schSo!st ^?he ?asJ aioun°«? P^^®"tal 

pJoc^du^efforp^^^^^ or 

p?imaJy%choo!i°;here^^^^^ infoSeiC®^^®^^^®"^ 

matters by the school • 4. various educational 

J2rj;;irs3 

Trends; Educational Outcomes: Measurina°stSLt"f ®^P®''^^ture 

SySnfSSiSois'^^EaSS? Si” Wor^.-SIrSIrS'* 

on interpretation of the data ident?f?"^* draws conclusions based 
discusseS the iBilSaSins S'aSSSSS P°licies, or 

chapter on Teachers' Pav and i policies. The last 

information for consiLring IPD acros2%?^°''^‘^®® ®°”® context 
explores projection! of ^SI !Se S ?L chapter 

the age distribution of current tefoh!!c 

to make tlaSiirSSaSlSSI'nirSIrSS 

s%“SireS”s:siircSiiSSi"SSS"as“SaSh?irs^“ ‘ ^ 

lSSibS”'^”SSSSfTdSlIInt~^^^^^^ 

in the past decade and declines in pupil-telcher rItiS*lII“ 

siisshS SuSSsi t-tSpirsidSt^ir 

implications Of teacher pay pIlici2"Sl‘’SenJlinn‘’SSltSl. 



NCES Publications on International Indicators 

tts*- NCES publications. Education Indicators' An 

^Perspective and International Education Indicators- 

CeSer of EduS??o^?^J“io^ai 

^ Statistics, 1996 and 1997) have compiled a 
son?™ education indicators from a variety^of 

S?e geared to^a the OECD reports beLuse they 

are geared to a U.S. audience. They focus on the United stai-«»s ^ 

in thrUn?ted"siSesf® important to the policy interests 



nartio^?a5t ^ includes sections on indicators of 

student flows; achievement and attainment- 
education and labor market destinations; education institutions 
(including indicators on teachers and t4aching) ; co??eJtual 

support for education. ®It a?2S |?o^?Ls 
<=°»Pa«tive infomation on countries' education 
systems. The second report, which provides a time series 
p rspective, includes twelve indicators presented in five 

and economic context of education- 
education; human and financial resources rwhich 
aa useful discussion of trends in s^uLn?!?eachSr ^ra^Jos 
oStcoLf?^^^° sector) ,- system outcomes; and labor market 



Other Reports that Provide country Context for Education 

Two additional publications that provide information aboni- 
o? education are the Internttional E^^^^ 

Ed ^ Education, Second Edition (Postlethwaite 

mathematics achievement ' 
- The former contains 152 articles on 
national systems of education covering a number of topics 
including general background information, e.g., geographical 
social structure, and economic factors; polices and aoalc; 

tor the education lyllL 

demographic characteristics, public^ 
education at primary and secondary levels and 
tables showing the TIMSS countries in which deciiion-makiAg 
regarding curriculum syllabi, textbooks, and examinations is 
nationally centralized, regionally centralized or not 
centralized. 



i 



REFERENCES: Part VI 

Providing Context 

Beaton, A. Mullis, M. o. Martin, E. J. Gonzalez, 

D. L. Kelly, and T. A. Smith. (I 996 a) . Mathematics 
Achievement in the Middle School Years; lEA^Tlhild 

Study (TiMSsf. 

^estnut Hill, MA: Center for the Study of Tes-Mnrr 

Evaluation, and Educational Policy, Boston College?' 

and 'principles for^jnter^°?^' ^ Framework 

Education ^ vlshinal^l f?®Parative Studies in 

hington, D.C.: National Academy Press. 

®nd V.L. Cobb, Eds. ( 1995 ) Teach&r 

So? ^ 

^^TA^M%ouhSef.°'BrSSe!sf 

progress. Princeton: Educational Testing Service. 

Organisation for Econonic Co-operation and Developnent. Centre 

It ^Glanll°^%^D^iVd%.V^ Innovation. ( 1996 a) . Education 
i^xance. OECD Indicators. Paris: Author. 

Organisation for Economic Co-operation and Development Centre 

K3;.iTSs“» '• —2 s‘;.“s. 



62 



O 

ERIC 



70 



Education 

2-ia.e le«“i 'llrsUcult TcITU A 

Education 

SalgSik licharl I 2n ,' ^ 2“"?^ Matheson, Laura Harsh 

and"iho»4s n^?t^; "Sa%^gf4g?^“‘‘SS? 



APPENDIX A 

COUNTRIES PARTICIPATING IN lEA STUDIES** *‘ 
Country computers in Rikding Literacy' 



Computers in 
Education 



Total Number 

Argentina 

Australia 

Austria 

Belgium (Flemish) 
Belgium (French) 

Botswana 

Bulgaria 

Canada 

Canada/BC 

Columbia 

Cyprus 

Czech Republic 

Denmark 

England 



12 



32 



X 

X 



X 

X 



Science 
and 
Math. 



45 

(X) 

X* 

X* 

X 

X* 



X* 

X 

X* 

X 

X 

X* 

X 



1996a and^®l996bf ?o^°not ^nc\u^e^®da^^ (Beaton et al., 
participation in indicated in countries whose 
Argentina, Italy, and Indonesia were una "(X)”. 
necessary for their data to appear in complete the steps 
characteristics of its school^^ssamnitf* reports. Because the 
achievement results for the Philioi^n*»«!^^^ completely known, 
reports in the tables comparing ^ included in thes4 
the testing portion of TIMSS, but chose noi- Participated in 
at grades 7 and 8 in the intWnational 

for coverage °oT the^tLget\opulatLn^®p^^ established 
age of students are tabulated seoarat^i rates, and the 
met the standards. Countries /ailina ^tf countries that 
sample participation rate^a^e A^sSIlf? guidelines for 
the Netherlands. CountriL not SSSia Bulgaria, and 
(high percentage of older students) ar^» specifications 
and Slovenia. Countries with unanr.y-o-,/°a Germany, Romania, 
classroom level are Denmark, Greel?^ South^lS^"^ procedures at 
Countries with unapproved sSmolina Africa, and Thailand, 
and not meeting other guidelines level 
these countries^ are sho?Si"fii{."r„ Slerfsrie“^-x^““"'^- 



STUDIES (continued) 



COUNTRIES PARTICIPATING IN lEA 

Country Computers in 

Education 



Reading 

Literacy 



Finland 

France 

Germany 

Germany (GDR) (East) 
Germany (FRG) (West) 

Greece 
Hong Kong 
Hungary 
Iceland 
India 

Indonesia 

Iran, Islam Republic 

Ireland 

Israel 

Italy 

Japan 

Korea, Republic of 

Kuwait 

Latvia 

Lithuania 

Mexico 
Netherlands 
New Zealand 
Nigeria 
Norway 

Philippines 

Portugal 

Romania 

Russia 

Scotland 



X 



X 



X 



X 

X 

X 



X 



Singapore 

Slovak Republic 

Slovenia X 

South Africa 

Spain 



X 

X 

X 

X 

X 

X 

X 

X 



X 

X 

X 



X 

X 

X 

X 

X 

X 



X 

X 

X 



Science 

and 

Math.. 



X 

X* 



X* 

X 

X 

X 



(X) 

X 

X 

X* 

(X) 

X 

X 

X* 

X 

X 

(X) 

X* 

X 

X 

(X) 

X 

X* 

X 

X* 

X 

X 

X* 

X* 

X 



PARTICIPATING IN lEA STUDIES 

Country Computers in 

Education 



(continued) 

Reading 

Literacy 



Science 

and 

Math. 



Sweden 

Switzerland 

Thailand 

Trinidad & Tobago 
United States 

Venezuela 

Zimbabwe 



X 

X 

X X 

X 

X X 

X 

X 



X 

X 

X* 

X 
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Reading Literacy study 

Table I items from the Teacher Questionnaire 



11 . 






Nona 

One ______ 

Two 

Three - 
Four or more 




1 

2 

3 

4 

5 



12 . 






None.. 

Once.. 

Twice. 



Three times. 



Four or more times g 



1 (Go to 0.15) 

2 

3 

4 



17. About how otten do you reed each of the followinfl? fC/rc/e one number per line only.) 



i 






» 







Never or 


About 


About 


About 


About 
once a 






almost 


onoe 


once 


once 


%veek or 






never 


a year 


a term 


a month 


more 


a. 


Articles on teachlng...._ 


1 


2 


3 


4 


c 


b. 


Articles on readlng..._.........__ 


1 


2 


3 


4 


w 

5 


c. 


Books on history or politics 


1 


2 


3 


4 


s 


d. 


Books on the arts 


1 


2 


3 


4 


w 

C 


e. 


Books on science 


1 


2 


3 


4 


o 

5 


f. 


Novels or short stories 


1 


2 


3 


4 


c 


0- 


Poems. . 


1 


2 


3 


4 


0 

c 


h. 


Plays.__ 


1 


2 


3 


4 


o 

c 


L 


Books for children ._.. 


1 


2 


3 


4 


0 

5 



64. Does the school principal (or deputy principal) ... (Circle one number per line only.) 



a discuss explicit achievement standards 

lor the subject that you teach? 

b. ask for evaluation results or progress of your 

students In reading? 

c. make suggestions about the choice of instructional 

methods in raadlnn? 

d. encourage contacts among teachers? 

e. initiate activities directed at the professional 

development of teachers? 

f. make suggestions about the content that must 

be covered In reading? 



1 2 

1 2 

1 2 
1 2 



1 2 



1 2 
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Reading Literacy Study 

Table I items from the Principal Questionnaire 



6 . 



Please indicate the availability of the folloivim resources 
number on each line,) 



In relation to your school? (Circle 



one 



Not readily 
avaOable 

Public library .... ^ 

Bookstore/book department 

In a store i 

Secondarylevelschool i 

A higher education Institution...-—^ i 
Museum , , , ^ 



Available k) 
neighboring 
townordty 
(leas than 2 hours 
of normal one ray 
travel time} 

2 

2 

2 

2 

2 



Available 

locally 

(^vlthin 30 minutes 
of rtormal one ray 
travel time) 

3 

3 

3 

3 

3 



Which of the following resources and activities are there In your school? (Circle 
each line.) 



one number on 



he Yes 

School library I 2 

Reading room for Rodents I 2 

Student/school newspaper or magazine ~ | 2 

Teacher (Professional) library ^ 



What Is the degree of parent cooperation edth the school In terms of support for the school's 
educational principles or goals (compared vrfth other schools you know)? (Circle one only.) 



Much below average t 

Below average g 

Average 3 

Above average 4 

Much above average 5 



Please rank the following acUvItles In order of Importance In your work as a school princioai rr 
fe^^r important eebyily. V is On laatl important aetMty, 7M’ - nor applicable. Do nor assign equal 



a. Representing the school at official mootings. 

b. Evaluation of staff 

c Contacts w*h local community (ag.. parents, community 

organizations, local Industry) 

d. Discussing educational objectives wtth the teaching staff. 

ft Mmlnlstratlve tasks-concemlng ttw functioning of the school 

(ftg.. regulations, disciplinary dufles; school budget, timetable) 

f. Using records of students' progress... 

g. Taking care of Issues of student %v^are and guidance 

h. Activities aimed at the professional development of teachers. 



Rank of 
importance 



Reading Literacy study 

Table III itens from the Principal Questionnaire 



- Books with different titles 



Teacher Questionnaire - 4th Grade 



14. 



tySiMF* ■"** minutes), excluding breaks, for this class in a 



Hours and ______ Minutes per week 



APPENDIX C 



Computer Education Study 

Table IV items from the Computer Education Teacher Questionnaire 

QuestLnnaire^flr^all^tLfhf^ Teacher and Computer Coordinator 
computer for instructional^iJpJLIo**®^ 



A, Self-Rating Items 



Please indicate below what you have learned so far about computers. 
For each particular statement, please cirde "yes" or "no". 



I know. 



Several advantages of computer use for instruction 


yes 


no 


The difference between a word processor and 
a desktop publishing program 


yes 


no 


Criteria to judge the quality of a printer 


yes 


no 


The trends in hardware development in the past 
20 years 


yes 


no 


What 'file extensions' are 


yes 


no 


What a 'loop' means in programming 


yes 


no 


What a 'relational database' is nifp. 


yes 


no 


What a 'bit' is defined as 


yes 


no 



The difference between "RAM' and "ROM' 



yes no 



Computer Educa^xon S^udy 

{coiliJuea?““ computer Education Teacher Questionnaire 



Lean write a prnf^ffj pt for . 

Adding up numbers 
Using arrays 

Storing data on a disk drive 

Sorting data into a certain sequence 
Printing the complete ASCH character set 

Lam cap able of. 

Exchanging data between different types of computers 
Copying files from one disk to another 
Editing documents with a word processor 
Loading a data set from a disk drive 
Creating a database-file 

Evaluating the usefulness of software for my lessons 
Adapting instructional software to my needs 
Writing courseware for my own lessons 



yes no 
yes no 

yes no 

yes no 

yes no 



yes no 

yes no 

yes no 

yes no 

yes no 

yes no 

yes no 

yes no 



Computer Education Study 

Table IV items from the Computer Education Teacher Questionnaire 



B. Problem List 



For each of the following problems, please indicate the seriousness of the problem 
that you experience in using computers for computer education in the target class. 
Please read and respond to each alternative. 

Problem Seriousness of problem 

Instruction 



Not enough help for supervising computer using 
students 


not 
at all 


minor 


major 


Difficult to integrate computers in my classroom 
instruction practices 


not 
at all 


minor 


major 


Integration of computer use in the existing 
prescribed class curriculum is difficult 


not 
at all 


minor 


major 


I lack knowledge / skills about using computers 
for instructional purposes 


not 
at all 


minor 


major 


Insufficient expertise / guidelines for helping 
me to use computers instnicUonally 


not 
at all 


minor 


major 


Organization /administration 


Insufficient training opportunities for me 


not 
at all 


minor 


major 


Lack of support or initiatives from the 
school administration 


not 
at all 


minor 


major 



Computer Education Study 

(loiliJLd?®"® Eduertion Teacher Ouestionnaire 



20. Below are statements about the use of compntent anrf thwr Impafft on fforin y- 

Please indicate for each of the following statements your persojud opinion. 
Try to give a spontaneous reaction by circling one opinion for each statement 

Statement 



Strongly 


Slightly 




Slightly 


Strongly 


disagree 


disagree 


Uncertain 


agree 


agree 


1 try to keep myself Informed about 
technological changes □< 




□> 






1 would like to take part in a computer 


course to learn more about computers . □' 




□> 






ln>service training courses about 


computers should be made compulsory . □' 




□> 


D* 




1 would like to learn more about 
computers as teaching aids □' 




□> 


D* 




1 don't mind learning about computers . □’ 




□> 


D* 





Computer Education Study 

(SitiSed?®"® coaputer Education Teacher Ouestionnaire 



€• Training Topics 



F^or e^h of the following computer-related topics, indicate whether you learned about 
it during teacher and/or in-service training? 

Please, circle one answer for each topic. 



Topic 



Computers and society 
History / evolution 

Relevance (e.g. for citizen, industry, education) 

Impact of computer applications (e.g. social, economical) 
Ethical issues (e.g. copyright, privacy) 

Applications 

Editing / word processing / desktop publishing 
Drawing / painting / illustrating 
Spreadsheets 
Database management 
Statistical application programs 



yes no 
yes no 

yes no 

yes no 



yes no 

yes no 

yes no 

yes no 

yes no 



Note that this item is also to be reoeated wi't-Vi ♦•vio ^ *.• 

indicate whether you taught them in your classes. ^opics. 



Computer Education study 

IcSntiJLd?®”^ Computer Education Teacher Questionnaire 

Topic 



Artificial intelligence / expert systems 


yes 


no 


Authoring languages 


yes 


no 


Models and simulations 


yes 


no 


Laboratory instnimentation 


yes 


no 


Scanning / image processing 


yes 


no 


CAD / CAM / process control / robotics 


yes 


no 


Telecommunications (e.g. electronic mail) / networks 


yes 


no 


Educational games / recreational gartv.c 


yes 


no 


Music generation j 


yes 


no 


Problem analysis and pcogranwiing 

General concepts (e.g. file, variable, array, loop, etc.) 


yes 


no 


General procedures (e.g. debugging) 


yes 


no 


Structure of programs (e.g. input, output, storage of 
data flow control) 


yes 


no 


Programming languages (e.g. Basic, Assembler, 
Pascal, Fortran) 


yes 


no 


Problem analysis (e.g. flowchart, story board, algorithms) 


yes 


no 



Computer Education Study 

Education Teacher Questionnaire 



Training Topics 
J'opic 



Principles of hard'Ond software structure 

Basic concepts about computers and computer systems 

Hardware (e.g. computer architecture, CPU, 
data flow control) 

Software (e.g. software architecture, system software) 

Pedagogical / instructional aspects 
Application of drill / practice / tutorial programs 
Locate overviews of existing software 
Evaluation of software 
Pedagogical / instructional aspeas 
Integration of software in existing lessons 
Organization of computer use during lessons 
Other (please specify) 



yes no 

yes no 

yes no 

yes no 

yes no 

yes no 

yes no 

yes no 



Computer Education Study 

Table IV items from the Computer Coordinator Questionnaire 
(These items are for the SASS Teacher and Computer Coordinator 
Questionnaire for all teachers in grades 5, 8, and 11 who use the 
computer for instructional purposes.) 

37. Roughly how many hours par week, on the average, do you spend in the following ways? [If you 
also work at other schools, count only the hours spent for THIS school.) 



Hours per week 
(estimate) 



a) Teaching students about computers and how to use them (including 

programming, word processing, etc.) 

b) Supervising students' computer use for other school subjects .... 

. — c) Training or helping teachers learn to use computers 

d) Selecting and providing computer-based instructional materials . . . 

e) Keeping equipment and programs in working order 

f) Writing (or adapting) instructional software 

g) Writing lesson plans integrating computer activities into curricular 

objectives 

— h) Developing your own computer-related skills 

i) Other computer-related activities (please specify): • 



35. 



Do you or someone else at your school function as a "computer coordinator" (informally or 
formally) - that is, someone on the school staff who coordinates teachers' Instrurtional use of 
computers and/or helps other teachers use computers? [Check the ONE BEST description for that 
person. If there is more than one person, describe the one person who spends the most time at 
this task.) 

A full-time school-level computer coordinator (who does not teach classes) 

A full-time regular teacher who also has the title of computer coordinator 
One teacher INFORMALLY provides leadership to other teachers who use computers . 

A district-level computer coordinator serves this function at our school 

The principal or another school administrator provides this function 

A part-time teacher serves as a computer coordinator 

Another person (please describe) 

NO ONE coordinates — teachers who use computers work out their own 
arrangements - If so, check this box and skip to 0.41 



□* 

n* ' 



Computer Education study 

C°»P»ter coordinator Questionnaire 



Whto of theto format staff davalopmant actfvitlas ara raadily avaBable for teachers at your school* 
Md ttuMQh i^t aoencles? ifor^^eh, eh0ckon§ormor§cho/ees,ss9pproprist§. if th9 ^cvwty 
is svsasois through somo othv soureo thsn thoso listed, pieese specify the source under ’Other. ■) 



Not 

avsUsbie 


School 


District 


College 


Other 


al Introductory courses in mine computers O' 


o» 


O* 


O' 




b) How to use appCcstion programs le.o.. 

word processors, spreadsheets) O' 


o» 


O* 


O' 




c) How to use computers In specific subjects . . O' 


O* 


o» 


O' 




d) Computer proerammine Instruction ... O' 


o» 


O* 


O' 




e) Computer electronics Irmruction T. O' 


O* 


O* 


fy 




f) Computer science courses for technical 
subjects 


n» 








g) Educational software development O' 


w 

o» 


w 

O* 


LJ* 

O' 




h) Evaluation of software using teaching O' 


o» 


D* 


O' 




0 Other (soeclfv): 


o» 


D* 


O' 





Schools make decisions about computers In different ways — decisions such as what additional 
hardware and softwara should bo acquired and which uses of computers should get priority At 
your school, who mainly makes each of tha foDowlng kinds of decisions? {Check the one or two 
MAJOR deciders for eech type of decision teiow.) 

{Note: inciude edisvict computer coordinetor under ’districf Check ’Comp, coord.’ for schooh 
ievei coordinators only, if none of the choices ere e^ropriete, write in your own exp/enetion.) 



a) 


Computer acquisition 
decisions 


District 


School 

admin. 

o* 


l^mp. 

coord. 

O* 


Group of 
toachert 


Each 

teacher 


Other 
(write 
title below) 

• 


b) 


Software acquisition 
decisions . • 




O* 






o» 


• 


c) 


Where computers should be 
located In the school 


. □’ 


o» 


□» 


□* 


O* 


• 


d) 


AUocatlng computer time 
among classes, subjects, 
and uses 


. O* 


O* 


O* 


□* 


o» 


• 


e) 


The content of computer 
literacy classes or units • . • • . 


. □' 


□* 


O* 


□* 




• 


f) 


The software to be used in a 
particular class 


. o* 


O* 


O* 


O* 




• 



Computer Education study 
Table IV items for Principals 



11 . 



To implemont computer use effeetively« tome schools find outside essistance valuable. Others 
have trouble Betting that help. In your ease, please indicate how outside groups and agencies 
have provided help and support for school computer activities In these four areas: 



TEACHER 


Training In the operation and use of computer hardware end 


TRAINING 


software 


INSTRUCTIONAL 


So that uachers improve their use of computers, including Integrat* 


SUPPORT 


big their use with the curriculum and organizing their use bi the 




classroom ^ 



Consider each column Cares of support*), and check the boxes for AU groups that ha>^glven Important 
support to your school In that area In the last several years. *lmportant support means that your school s 
use of computers would have clearly been different v^out their support. If no group has given important 
support In one of these areas, check the box for "None* for that area of support. 



Group or Agency Support 





Teacher 


bistructlonal 




training 


support 


U.S. government 


O’ 


0- 


State government 


O’ 


0‘ 


School district and Its personnel (including 
district computer coordinator) 


O’ 


0‘ 


Other education agencies including 
regional resource centers 


O’ 


0‘ 


Teachers at other schools 


O’ 


D* 


Computer manufacturers 


O’ 


0‘ 


Software producers 


O’ 


0‘ 


Local computer retailer 


O’ 


0‘ 


Local businesses (other than computer 
stores) 


O’ 


D* 


Colleges or universities 


O’ 


□- 




O’ 


□- 


Computer clubs and hobbyists 


O’ 


0- 


Teacher associations 


O’ 


0- 


Other associations 


O’ 


0- 


Iplimcii ABACifv) .... 


O’ 


0- 


None (no group has given that type 


O’ 


0- 



Computer Education Study 

Table IV items for Principals (continued) 



5 . 



,.k.„ p,.„ .. ,our.cho« ,».«* 







How often since 


September? 




Not 


Some 


Most 


Every 




at all 


weeks 


weeks 


week 


Teachers met to exchange information about the 


use of computers 






□* 




A teacher exchanged information about 


computers with teachers at other schools .... 




□» 


□* 




We assessed how the computers were beino 


used and made organizational adjustments 
accordinolv 






□* 


✓ 



Table V Items from the Computer Coordinator Questionnaire 
(These items are for the SASS Teacher and Computer Coordinator 
Questionnaire for all teachers in grades 5, 8, and ll who use the 
coinpu*ter for instructional purposes*} 

28. Roughly, what percentage of students In each of the following grades receive Instruction about 
computers as part of the school curriculum, and how many hours of Instruction during the school 
year do stodents at those grades typically receive? Estimates are sufficient; ignore grade ieveis not 
present at your school and those omitted from the iist beiow. 

Instruction ABOUT computers Percent of students Hours per year 

a) Grade 10 

b) Grade 11 

c) Grade 12 



Item 37. a, b, d, e, f, and i: Computer Coordinator's 

Activities not Related to IPD. See Item 37 in Table IV 



Computer Education Study 
Table V items for Principals 



6 . 



Some schools, districts, and states establish specific policies about computer use For e«ch 
established any policies bi that area for schools like yours. 

Ufno pdicies in an area affect your school, check 'No Policy" on that Una. If policies exist at 
'^tVstate'^agMc^^^^^ '/>»fe/mecr/afe administrative unH" 



Policy area 



Policy maker 



A policy requiring a minimum amount of computer 
training for certification of teachers of other 
subjects 



No 

policy 


School 

policy 


District 

policy 


State 

policy 


□' 


□» 




□« 



APPENDIX D 



Components of TIMSS''' 

Achievement tests and performance assessments 



the*flllSwing'^topics:^*" °"^y for grade eight) covered 



Mathematics 

• Fractions and number sense 

• Geometry 

• Algebra 

• Proportionality 

• Data representation, 
analysis and probability 

• Measurement 



Science 

Earth science 
Life science 
Physics 
Chemistry 
Science and the 
environment 



Questionnaires 



Student Survey 



Teacher Surveys 



• Attitudes toward mathematics and 

background and science 

education 

• Personal/academic backgrounds • 

• School experiences • 

• Career/ educational goals • 

science 



• Teacher 



Instructional practices 
Pedagogical beliefs 
Views about mathematics and 



School Administrator Snyvoye 

• Curricula 

• School climate 

organization 

• Staffing levels 

• Availability of services 



as disciplines 

Count ry —Level Surveys 

• Information on each educa- 
tional system's 

and structure 



’’source; (Owen, 1996) 



Components of tiMSS (continued) 
Curriculum analyses 



The curriculum content of 
and curriculum 
following information: 



more than 1,600 mathematics and 
guides was analyzed to obtain the 



science 



• When topics are introduced 

or »»thenatics 

’ competing for students' 

• What students are erpected to ho j«v»i a ^ 

mathematics and science they iLrn ^ 

Videotapes 

Lesson organization 
Mathematics content 
Instructional methods 
The nature of mathematics discourse 

inillSiver‘’“®’'“‘’^”® i-»plementetlon Of reform 
case Studies 

SSjHseffoumpfSf^^ "" 

r Implementation of national standards 

• roTo^o? environment and training of teachers 

• secondary schools in adolescents' lives 

Ability differences and tracking lives 



APPENDIX E 



Third Inhernahional Mathematics and Science Study 
Table VI items from the Teacher Questionnaire 



12. APPROXIMATELY how many hours per week do you 

normally spend on each of the following activities outside 
the formal school day? 

Check one box in each row. 



13 . 



e) meedng with parents 

f) professional reading and development activity 

(e.g., seminars, coirferences, etc.) 



none 


less 
than 1 
hour 


1-2 

hours 


3-4 

hours 


more 
than 4 
hours 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 


□ 



About how often do you have meetings with other teachers 
in your subject area to discuss and plan curriculum or 
teaching approaches? 

Check one box only. 



never 

once or twice a year 

every other month 

once a month 

once a week 

two or three times a week 
almost every day 



□ 

□ 

□ 

□ 

□ 

□ 

□ 



Tabif Mathematics and Science Study 

Table VI Items from the Principal Questionnaire 



11 . 



As principal of this school, about how many hours per month 
do you usually spend on each of the following activities? 



Please indicate the approximate 
number of hours for each item. 
Please write 0 (zero) if no time is 
spent on an activity. 



hours 
per month 

f) Giving a demonstration less on 

g) Discussing educational objectives with teachers 

I) Training teachers 



10. Cooperation and Collaboration: 



a) Does your school have an official policy related to promoting 

cooperation and collaboration among teachers? 

b) An teachers in your school encouraged to share and 

discuss instructional ideas and materials? 

c) Do teachers in your school meet regularly to discuss instructional 

goals and issues? 



t3. 



How much influence does each ofthe^oliowing havelii 
determining the curriculum that is taught in your school? 



Check one box 
for each line. 

Yes No 



0 D 
□ □ 
□ □ 



Check one box in each line. 



f) Teachers (collectively for the school) 

g) Teachers, (of same subject) as a group 

h) Each teacher individually 



none a little some a lot 

P □ □ 

^ D o 0 
O □ □ 



Listing of NCES Working Papers to Date 

Please contact Ruth R. Harris at (202) 219-1831 
if you are interested in any of the following papers 



Number 


Title 


Contact 


94-01 (July) 


Schools and Staffing Survey (SASS) Papers Presented 
at Meetings of the American Statistical Association 


Dan Kasprzyk 


94-02 (July) 


Generalized Variance Estimate for Schools and 
Staffing Survey (SASS) 


Dan Kasprzyk 


94-03 (July) 


1991 Schools and Staffing Survey (SASS) Reinterview 
Response Variance Report 


Dan Kasprzyk 


94-04 (July) 


The Accuracy of Teachers' Self-reports on their 
Postsecondary Education: Teacher Transcript Study, 
Schools and Staffing Survey 


Dan Kasprzyk 


94-05 (July) 


Cost-of-Education Differentials Across the States 


William Fowler 


94-06 (July) 


Six Papers on Teachers from the 1990-91 Schools and 
Staffing Survey and Other Related Surveys 


Dan Kasprzyk 


94-07 (Nov.) 


Data Comparability and Public Policy: New Interest in 
Public Library Data Papers Presented at Meetings of 
the American Statistical Association 


Carrol Kindel 


95-01 (Jan.) 


Schools and Staffing Survey: 1994 Papers Presented at 
the 1994 Meeting of the American Statistical 
Association 


Dan Kasprzyk 


95-02 (Jan.) 


QED Estimates of the 1990-91 Schools and Staffing 
Survey: Deriving and Comparing QED School 
Estimates with CCD Estimates 


Dan Kasprzyk 


95-03 (Jan.) 


Schools and Staffing Survey: 1990-91 SASS Cross- 
Questionnaire Analysis 


Dan Kasprzyk 


95-04 (Jan.) 


National Education Longitudinal Study of 1988: 
Second Follow-up Questionnaire Content Areas and 
Research Issues 


Jeffrey Owings 


95-05 (Jan.) 


National Education Longitudinal Study of 1988: 
Conducting Trend Analyses of NLS-72, HS&B, and 
NELS:88 Seniors 


Jeffrey Owings 
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Listing of NCES Working Papers to Date— Continued 



Number 


Title 


Contact 


95-06 (Jan.) 


National Education Longitudinal Study of 1988: 
Conducting Cross-Cohort Comparisons Using HS«feB, 
NAEP, and NELS:88 Academic Transcript Data 


Jeffrey Owings 


95-07 (Jan.) 


National Education Longitudinal Study of 1988: 
Conducting Trend Analyses HS&B and NELS:88 
Sophomore Cohort Dropouts 


Jeffrey Owings 


95-08 (Feb.) 


CCD Adjustment to the 1990-91 SASS: A Comparison 
of Estimates 


Dan Kasprzyk 


95-09 (Feb.) 


The Results of the 1993 Teacher List Validation Study 
(TLVS) 


Dan Kasprzyk 


95-10 (Feb.) 


The Results of the 1991-92 Teacher Follow-up Survey 
(TFS) Reinterview and Extensive Reconciliation 


Dan Kasprzyk 


95-1 1 (Mar.) 


Measuring Instruction, Curriculum Content, and 
Instructional Resources: The Status of Recent Work 


Sharon Bobbitt & 
John Ralph 


95-12 (Mar.) 


Rural Education Data User's Guide 


Samuel Peng 


95-13 (Mar.) 


Assessing Students with Disabilities and Limited 
English Proficiency 


James Houser 


95-14 (Mar.) 


Empirical Evalxiation of Social, Psychological, & 
Educational Construct Variables Used in NCES 
Surveys 


Samuel Peng 


95-15 (Apr.) 


Classroom Instructional Processes: A Review of 
Existing Measurement Approaches and Their 
Applicability for the Teacher Follow-up Survey 


Sharon Bobbitt 


95-16 (Apr.) 


Intersurvey Consistency in NCES Private School 
Surveys 


Steven Kaiifinan 


95-17 (May) 


Estimates of Expenditures for Private K-12 Schools 


Stephen 

Broughman 


95-18 (Nov.) 


An Agenda for Research on Teachers and Schools: 
Revisiting NCES' Schools and Staffing Survey 


Dan Kasprzyk 


96-01 (Jan.) 


Methodological Issues in the Study of Teachers' 
Careers: Critical Features of a Truly Longitudinal 
Study 


Dan Kasprzyk 



Listing of NCES Working Papers to Date-Continued 
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96-02 (Feb.) 
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96-04 (Feb.) 
96-05 (Feb.) 

96-06 (Mar.) 

96-07 (Mar.) 
96-08 (Apr.) 
96-09 (Apr.) 

96-10 (Apr.) 
96-11 (June) 

96-12 (June) 

96-13 (Jime) 
96-14 (June) 



Title 

Schools and Staffing Survey (SASS): 1995 Selected 
papers presented at the 1995 Meeting of the American 
Statistical Association 

National Education Longitudinal Study of 1988 
(NELS:88) Research Framework and Issues 

Census Mapping Project/School District Data Book 

Cognitive Research on the Teacher Listing Form for 
the Schools and Staffing Survey 

The Schools and Staffing Survey (SASS) for 1998-99: 
Design Recommendations to Inform Broad Education 
Policy 

Should SASS Measure Instructional Processes and 
Teacher Effectiveness? 

How Accurate are Teacher Judgments of Students' 
Academic Performance? 

Making Data Relevant for Policy Discussions: 
Redesigning the School Administrator Questionnaire 
for the 1998-99 SASS 

1998-99 Schools and Staffing Survey: Issues Related to 
Survey Depth 

Towards an Organizational Database on America's 
Schools: A Proposal for the Future of SASS, with 
comments on School Reform, Governance, and Finance 

Predictors of Retention, Transfer, and Attrition of 
Special and General Education Teachers: Data fi'om the 
1989 Teacher Followup Survey 

Estimation of Response Bias in the NHES:95 Adult 
Education Survey 

The 1995 National Household Education Survey: 
Reinterview Results for the Adult Education 
Component 



Contact 
Dan Kasprzyk 

Jeffrey Owings 

Tai Phan 
Dan Kasprzyk 

Dan Kasprzyk 

Dan Kasprzyk 
Jerry West 
Dan Kasprzyk 

Dan Kasprzyk 
Dan Kasprzyk 

Dan Kasprzyk 

Steven Kaufinan 
Steven Kaufinan 



Listing of NCES Working Papers to Date— Continued 



Number 


Title 


Contact 


96-15 (June) 


Nested Structures: District-Level Data in the Schools 
and Staffing Survey 


Dan Kasprzyk 


96-16 (June) 


Strategies for Collecting Finance Data from Private 
Schools 


Stephen 

Broughman 


96-17 (July) 


National Postsecondary Student Aid Study: 1996 Field 
Test Methodology Report 


Andrew G. 
Malizio 


96-18 (Aug.) 


Assessment of Social Competence, Adaptive 
Behaviors, and Approaches to Learning with Young 
Children 


Jerry West 


96-19 (Oct.) 


Assessment and Analysis of School-Level 
Expenditures 


William Fowler 


96-20 (Oct.) 


1991 National Household Education Survey 
(NHES:91) Questionnaires: Screener, Early Childhood 
Education, and Adult Education 


Kathryn Chandler 


96-21 (Oct.) 


1 993 National Household Education Survey 
(NHES:93) Questionnaires: Screener, School 
Readiness, and School Safety and Discipline 


Kathryn Chandler 


96-22 (Oct.) 


1995 National Household Education Survey 
(NHES:95) Questionnaires: Screener, Early Childhood 
Program Participation, and Adult Education 


Kathryn Chandler 


96-23 (Oct.) 


Linking Student Data to SASS: Why, When, How 


Dan Kasprzyk 


96-24 (Oct.) 


National Assessments of Teacher Quality 


Dan Kasprzyk 


96-25 (Oct.) 


Measures of Inservice Professional Development: 
Suggested Items for the 1998-1999 Schools and 
Staffing Survey 


Dan Kasprzyk 


96-26 (Nov.) 


Improving the Coverage of Private Elementary- 
Secondary Schools 


Steven Kaufman 


96-27 (Nov.) 


Intersurvey Consistency in NCES Private School 
Surveys for 1993-94 


Steven Kaufrnan 
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96-28 (Nov.) 

96-29 (Nov.) 

96- 30 (Dec.) 
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97-03 (Feb.) 

97-04 (Feb.) 
97-05 (Feb.) 
97-06 (Feb.) 
97-07 (Mar.) 
97-08 (Mar.) 



Title 

Student Learning, Teaching Quality, and Professional 
Development: Theoretical Linkages, Current 
Measurement, and Recommendations for Future Data 
Collection 

Undercoverage Bias in Estimates of Characteristics of 
Adults and 0- to 2- Year-Olds in the 1995 National 
Household Education Survey (NHES:95) 

Comparison of Estimates from the 1995 National 
Household Education Survey (NHES:95) 

Selected Papers on Education Surveys: Papers 
Presented at the 1996 Meeting of the American 
Statistical Association 

Telephone Coverage Bias and Recorded Interview's in 
the 1993 National Household Education Survey 
(NHES:93) 

1991 and 1995 National Household Education Survey 
Questionnaires: NHES:91 Screener, NHES:91 Adult 
Education, NHES:95 Basic Screener, and NHES:95 
Adult Education 

Design, Data Collection, Monitoring, Interview 
Administration Time, and Data Editing in the 1993 
National Household Education Survey (NHES:93) 

Unit and Item Response, Weighting, and Imputation 
Procedures in the 1993 National Household Education 
Survey (NHES:93) 

Unit and Item Response, Weighting, and Imputation 
Procedures in the 1995 National Household Education 
Survey (NHES:95) 

The Determinants of Per-Pupil Expenditures in Private 
Elementary and Secondary Schools: An Exploratory 
Analysis 

Design, Data Collection, Interview Timing, and Data 
Editing in the 1995 National Household Education 
Survey 



Contact 

Mary Rollefson 

Kathryn Chandler 

Kathryn Chandler 
Dan Kasprzyk 

Kathryn Chandler 

Kathryn Chandler 

Kathryn Chandler 

Kathryn Chandler 

Kathryn Chandler 

Stephen 

Broughman 

Kathryn Chandler 



Listing of NCES Working Papers to Date— Continued 



Number 
97-09 (Apr.) 

97-10 (Apr.) 
97-11 (Apr.) 



Title 

Status of Data on Crime and Violence in Schools: Final 
Report 

Report of Cognitive Research on the Public and Private 
School Teacher Questionnaires for the Schools and 
Staffing Survey 1993-94 School Year 

International Comparisons of Inservice Professional 
Development 



Contact 
Lee Hoffinan 

Dan Kasprzyk 
Mary Rollefson 
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